00000001:02000400:1.0F:1788509150.260136:0:3297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788509170.841304:0:3521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788509173.102277:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 569 MB/s 00000001:01000000:3.0:1788509173.354813:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 517 MB/s 00000001:01000000:0.0F:1788509173.606642:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2723 MB/s 00000020:02000000:1.0:1788509174.667844:0:3613:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g439d16b 00000400:02000000:1.0:1788509175.619412:0:3628:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.112@tcp [8/256/0/180] 00008000:02000000:3.0:1788509179.167062:0:3778:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0F:1788509245.241261:0:5747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788509261.481095:0:6497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788509261.481102:0:6497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788509261.481104:0:6497:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788509261.481372:0:6497:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b0987b76 00000080:02000400:2.0:1788509261.481429:0:6497:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788509261.492013:0:6497:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788509261.492025:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788509261.492084:0:6497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004c9fb5ca) 00000020:00000080:2.0:1788509261.492108:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788509261.566126:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788509261.566243:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788509261.595587:0:6497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788509261.595813:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788509261.595821:0:6497:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788509261.595832:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dd366 00000020:01000004:2.0:1788509261.595838:0:6497:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788509261.595843:0:6497:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788509261.595847:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b0987b76 from MGS 00000020:01000004:2.0:1788509261.595852:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788509261.595861:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000248a808a) 00000020:00000080:2.0:1788509261.595869:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788509261.596148:0:6497:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b0987b76 from MGS, refs=2 00080000:01000000:2.0:1788509261.596154:0:6497:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788509261.596160:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dd374 00000100:00100000:2.0:1788509261.596353:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788509261.596612:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788509261.596619:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788509261.597744:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788509261.597753:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788509261.598855:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509261.601718:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788509261.601727:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788509261.604156:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788509261.604168:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788509261.604741:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788509261.604749:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788509261.612723:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509261.612734:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509261.612736:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509261.614453:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509261.614459:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509261.614461:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509261.615273:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788509261.626510:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788509261.865977:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1697 MB/s 00000001:01000000:3.0:1788509262.126934:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5039 MB/s 00000001:01000000:2.0:1788509262.377787:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 463 MB/s 00000001:01000000:2.0:1788509262.633567:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 417 MB/s 00080000:10000000:0.0:1788509262.645806:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788509262.663393:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788509262.666275:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788509262.666322:0:6497:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788509262.666370:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788509262.666558:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788509262.666579:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788509262.670407:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509262.670579:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788509262.670585:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788509262.671682:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788509262.671690:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788509262.672265:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788509262.672271:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788509262.673162:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788509262.673182:0:6497:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:1.0:1788509262.673183:0:6497:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788509262.673235:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:1.0:1788509262.673253:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (00000000985a43e8) 00000020:00000080:1.0:1788509262.673269:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788509262.673370:0:6497:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000030193e4e@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509262.673532:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:1.0:1788509262.673539:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788509262.679194:0:6516:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788509262.679651:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788509262.679699:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid f3f21fff-d4b5-454c-a2da-1a3157f8f73e) 00000020:00000080:2.0:1788509262.679721:0:6497:0:(genops.c:1385:class_connect()) connect: client f3f21fff-d4b5-454c-a2da-1a3157f8f73e, cookie 0xe5156b86310dd382 00000100:00080000:2.0:1788509262.679732:0:6497:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788509262.679737:0:6497:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import 0000000030193e4e using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509262.679783:0:6497:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f89029ea x1875387796684928/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509262.679888:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f89029ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3643:1875387796684928:0@lo:250: 00000100:00100000:2.0:1788509262.679999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788509262.680060:0:6497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS 00000020:01000004:2.0:1788509262.680078:0:6497:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788509262.680082:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788509262.680095:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fd02ee5e) 00000020:00000080:2.0:1788509262.680105:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788509262.686636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796684928 00000100:00100000:3.0:1788509262.686651:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796684928 00000100:00100000:3.0:1788509262.686707:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509262.686714:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a4bc263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875387796684928:12345-0@lo:250: 00010000:00080000:3.0:1788509262.686741:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f3f21fff-d4b5-454c-a2da-1a3157f8f73e@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:3.0:1788509262.686767:0:6513:0:(genops.c:1385:class_connect()) connect: client f3f21fff-d4b5-454c-a2da-1a3157f8f73e, cookie 0xe5156b86310dd390 00000100:00080000:3.0:1788509262.686891:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000cc600a6b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788509262.687010:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a4bc263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:3643:x1875387796684928:12345-0@lo:250: Request processed in 295us (7012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509262.687018:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509262.687097:0:3643:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788509262.687106:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:3.0:1788509262.687113:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788509262.687117:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788509262.687120:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000030193e4e MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788509262.687122:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788509262.687130:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788509262.687135:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f89029ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3643:1875387796684928:0@lo:250: 00010000:00010000:1.0:1788509262.687921:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509262.698840:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509262.708441:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788509262.708450:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788509262.710198:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788509262.710210:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788509262.710718:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788509262.710725:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788509262.712825:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788509262.713074:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788509262.713080:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788509262.715152:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788509262.715166:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788509262.786272:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509262.786484:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788509262.786491:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788509262.794644:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788509262.794663:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788509262.795649:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509262.795820:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788509262.795826:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788509262.796555:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788509262.796563:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788509262.797514:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509262.797713:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788509262.797719:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788509262.802098:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788509262.802111:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788509262.802678:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509262.802830:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788509262.802834:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788509262.803467:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788509262.803473:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788509262.832196:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509262.832421:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788509262.832428:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788509262.834729:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788509262.834778:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788509262.840339:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788509262.840354:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788509262.843933:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788509262.843967:0:6497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788509262.843973:0:6497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788509262.844084:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788509262.844117:0:6497:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788509262.844122:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788509262.844123:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788509262.844124:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509262.844126:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509262.844127:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509262.844128:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509262.844129:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788509262.844131:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788509262.844132:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788509262.844133:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788509262.844134:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509262.844136:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788509262.844138:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788509262.844140:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788509262.844147:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788509262.844148:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509262.844149:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509262.844150:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509262.844151:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509262.844152:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788509262.844153:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788509262.844153:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788509262.844154:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788509262.844155:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509262.844156:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788509262.844180:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788509262.844196:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000267b29ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685056:0@lo:253: 00000100:00100000:2.0:1788509262.844268:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509262.844337:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000160a9cc8 going to sleep for 11 seconds 00000100:00100000:3.0:1788509262.844560:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796685056 00000100:00100000:3.0:1788509262.844567:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796685056 00000100:00100000:3.0:1788509262.844606:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509262.844614:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aeb3fe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:6497:x1875387796685056:12345-0@lo:253: 20000000:01000000:3.0:1788509262.844657:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788509262.844660:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788509262.845196:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788509262.845249:0:6515:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788509262.845473:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509262.846289:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788509262.846460:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788509262.846465:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788509262.846470:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788509262.846473:0:6515:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788509262.846484:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788509262.846601:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509262.846743:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788509262.846756:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788509262.846773:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788509262.846786:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788509262.846800:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788509262.846845:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788509262.846852:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788509262.846865:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788509262.846870:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788509262.846881:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788509262.846885:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788509262.846927:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788509262.846947:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788509262.846972:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788509262.846976:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788509262.846982:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509262.847090:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788509262.847100:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788509262.847115:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788509262.847129:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788509262.847153:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788509262.847162:0:6515:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788509262.847186:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788509262.847193:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788509262.847206:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788509262.847219:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788509262.847233:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788509262.847242:0:6515:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788509262.847264:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788509262.847272:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788509262.847285:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788509262.847314:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788509262.847381:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788509262.847404:0:6515:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788509262.847411:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788509262.853614:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788509262.853842:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788509262.853867:0:6515:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:3.0:1788509262.853869:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1788509262.853884:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788509262.853890:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788509262.853958:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788509262.853965:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1788509262.853977:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788509262.853984:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788509262.853994:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788509262.854007:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788509262.854045:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788509262.854049:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788509262.854053:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788509262.854108:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788509262.854110:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788509262.855124:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788509262.855346:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788509262.855369:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788509262.855397:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788509262.855406:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788509262.855408:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788509262.856084:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788509262.856265:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788509262.856286:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788509262.856298:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788509262.856307:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788509262.856309:0:6515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788509262.856314:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788509262.856316:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788509262.856321:0:6515:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788509262.856327:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788509262.861476:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788509262.861765:0:6515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788509262.875088:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788509262.875127:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788509262.875144:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788509262.875400:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788509262.875426:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875442:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875451:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875457:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875462:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875486:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875492:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c080cdca already unused, calling callback (00000000b73d62c5) 00010000:00010000:2.0:1788509262.875495:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875503:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875515:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875522:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.875528:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c080cdca/0xe5156b86310dd397 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788509262.875546:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788509262.894754:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aeb3fe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:6497:x1875387796685056:12345-0@lo:253: Request processed in 50132us (50479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509262.894773:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509262.894875:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000267b29ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685056:0@lo:253: 10000000:01000000:0.0:1788509262.894892:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788509262.894926:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788509262.894929:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788509262.894930:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509262.894931:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788509262.894933:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509262.894934:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509262.894936:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788509262.894938:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788509262.894939:0:6497:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788509262.894940:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509262.894942:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788509262.894961:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b0987b76 from lustre-MDT0000 10000000:01000000:0.0:1788509262.894990:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788509262.895004:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788509262.895008:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8bcd9e5d99c0 10000000:01000000:0.0:1788509262.895012:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788509262.895019:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bcd9e5d99c0 from 1 10000000:01000000:0.0:1788509262.895023:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788509262.895085:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509262.895096:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509262.895104:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509262.895122:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f097f1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685184:0@lo:101: 00000100:00100000:0.0:1788509262.895172:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509262.895216:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b9b5b4 going to sleep for 11 seconds 00000100:00100000:1.0:1788509262.895343:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796685184 00000100:00100000:1.0:1788509262.895350:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796685184 00000100:00100000:1.0:1788509262.895524:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509262.895537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069bf2492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:6497:x1875387796685184:12345-0@lo:101: 00010000:00010000:1.0:1788509262.895548:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509262.895561:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd39e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509262.895585:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd39e expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509262.895594:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd39e expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509262.895602:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000623b06ef, rc 0) 00000100:00100000:1.0:1788509262.895667:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069bf2492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:6497:x1875387796685184:12345-0@lo:101: Request processed in 131us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509262.895673:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788509262.895749:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f097f1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685184:0@lo:101: 00010000:00010000:2.0:1788509262.895762:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.895770:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509262.895849:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685312:0@lo:501: 00000100:00100000:2.0:1788509262.895876:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509262.895924:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eae45c3 going to sleep for 11 seconds 00000100:00100000:2.0:1788509262.895938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796685312 00000100:00100000:2.0:1788509262.895942:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796685312 00000100:00100000:2.0:1788509262.895964:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788509262.895969:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6ad44d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:6497:x1875387796685312:12345-0@lo:501: 00000100:00100000:2.0:1788509262.896055:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6ad44d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:6497:x1875387796685312:12345-0@lo:501: Request processed in 85us (178us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509262.896062:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788509262.896094:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685312:0@lo:501: 10000000:01000000:2.0:1788509262.896118:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788509262.896136:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896143:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509262.896150:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bcd82e88800 10000000:01000000:2.0:1788509262.896153:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788509262.896157:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8bcd82e88800 10000000:01000000:2.0:1788509262.896159:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788509262.896161:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8bcd82e88800 from 1 10000000:01000000:2.0:1788509262.896163:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788509262.896178:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c080cdca/0xe5156b86310dd3ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896195:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000c080cdca/0xe5156b86310dd3ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896203:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000c080cdca/0xe5156b86310dd3ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509262.896213:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685440:0@lo:101: 00000100:00100000:2.0:1788509262.896237:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509262.896253:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eae45c3 going to sleep for 11 seconds 00000100:00100000:2.0:1788509262.896265:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796685440 00000100:00100000:2.0:1788509262.896269:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796685440 00000100:00100000:2.0:1788509262.896284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788509262.896289:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fe670f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:6497:x1875387796685440:12345-0@lo:101: 00010000:00010000:2.0:1788509262.896295:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509262.896302:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2687c65/0xe5156b86310dd3b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd3ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896315:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2687c65/0xe5156b86310dd3b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd3ac expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896323:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2687c65/0xe5156b86310dd3b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd3ac expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896329:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2687c65, rc 0) 00000100:00100000:2.0:1788509262.896355:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fe670f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+7:6497:x1875387796685440:12345-0@lo:101: Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509262.896360:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788509262.896403:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685440:0@lo:101: 00010000:00010000:2.0:1788509262.896417:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000c080cdca/0xe5156b86310dd3ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896423:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000c080cdca/0xe5156b86310dd3ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509262.896432:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788509262.896435:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c080cdca/0xe5156b86310dd3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896440:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000c080cdca/0xe5156b86310dd3ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509262.896445:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788509262.896447:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788509262.896451:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8bcd82e88800 10000000:01000000:2.0:1788509262.896452:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788509262.896454:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788509262.896456:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788509262.896467:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896473:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896478:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509262.896488:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685568:0@lo:101: 00000100:00100000:2.0:1788509262.896512:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509262.896533:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eae45c3 going to sleep for 11 seconds 00000100:00100000:2.0:1788509262.896545:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796685568 00000100:00100000:2.0:1788509262.896549:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796685568 00000100:00100000:2.0:1788509262.896566:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788509262.896570:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a2e3d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+7:6497:x1875387796685568:12345-0@lo:101: 00010000:00010000:2.0:1788509262.896576:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509262.896582:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd3ba expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896593:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896600:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896606:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008ae0549, rc 0) 00000100:00100000:2.0:1788509262.896631:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a2e3d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+8:6497:x1875387796685568:12345-0@lo:101: Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509262.896636:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788509262.896664:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685568:0@lo:101: 00010000:00010000:2.0:1788509262.896673:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509262.896680:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509262.896714:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685696:0@lo:501: 00000100:00100000:2.0:1788509262.896736:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509262.896748:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eae45c3 going to sleep for 11 seconds 00000100:00100000:2.0:1788509262.896767:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796685696 00000100:00100000:2.0:1788509262.896770:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796685696 00000100:00100000:2.0:1788509262.896788:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509262.896792:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046d24504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+8:6497:x1875387796685696:12345-0@lo:501: 00000100:00100000:2.0:1788509262.896877:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046d24504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:6497:x1875387796685696:12345-0@lo:501: Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509262.896883:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509262.896949:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685696:0@lo:501: 00000100:00100000:2.0:1788509262.896974:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685824:0@lo:503: 00000100:00100000:2.0:1788509262.897010:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509262.897029:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eae45c3 going to sleep for 11 seconds 00000100:00100000:2.0:1788509262.897053:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796685824 00000100:00100000:2.0:1788509262.897056:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796685824 00000100:00100000:2.0:1788509262.897074:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788509262.897078:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf67584b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:6497:x1875387796685824:12345-0@lo:503: 00000100:00100000:2.0:1788509262.897148:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf67584b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:6497:x1875387796685824:12345-0@lo:503: Request processed in 68us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509262.897154:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788509262.897188:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796685824:0@lo:503: 00000100:00100000:1.0:1788509262.900994:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000963a2793 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6542:1875387796685952:0@lo:502: 00000100:00100000:1.0:1788509262.901091:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509262.901135:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000119314b2 going to sleep for 11 seconds 00000100:00100000:2.0:1788509262.902751:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796685952 00000100:00100000:2.0:1788509262.902764:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796685952 00000100:00100000:2.0:1788509262.902826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788509262.902835:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbfaeb58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:6542:x1875387796685952:12345-0@lo:502: 00000100:00100000:2.0:1788509262.903005:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbfaeb58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:6542:x1875387796685952:12345-0@lo:502: Request processed in 171us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509262.903013:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509262.903399:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000963a2793 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6542:1875387796685952:0@lo:502: 00000020:01000000:1.0:1788509262.903436:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509262.903450:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509262.903453:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788509262.903458:0:6542:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788509262.903461:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509262.903474:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e4016304) 00000020:00000080:1.0:1788509262.903492:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788509262.903498:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788509262.903593:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788509262.903600:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dd3cf 00000020:00000080:1.0:1788509262.903849:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788509262.903866:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509262.903870:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509262.903872:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788509262.903874:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509262.903877:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509262.903879:0:6542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788509262.903882:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509262.903889:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000014a4f4b1) 00000020:00000080:1.0:1788509262.904686:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788509262.904709:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788509262.904711:0:6542:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788509262.904714:0:6542:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788509262.904721:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788509262.904850:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b0987b76 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788509262.904867:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000276e8c25) 00000020:00000080:1.0:1788509262.904875:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788509262.905218:0:6542:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788509262.905226:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dd3e4 00000020:00000080:1.0:1788509262.905338:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788509262.905344:0:6542:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788509262.905348:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe5156b86310dd3eb 00080000:01000000:1.0:1788509262.905354:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788509262.905358:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dd3f2 00080000:10000000:1.0:1788509262.908158:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788509262.908350:0:6542:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788509262.915691:0:6542:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788509263.046697:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788509263.047104:0:6542:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788509263.051691:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788509263.052104:0:6542:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788509263.056027:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000bbe75316) 00000020:00000080:0.0:1788509263.056062:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788509263.056201:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788509263.056208:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dd400 00000020:00000080:0.0:1788509263.056861:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788509263.060235:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788509263.071489:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788509263.075330:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788509263.080603:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788509263.090172:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788509263.100759:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788509263.110672:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe5156b86310dd407 00000020:00000080:1.0:1788509263.111275:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788509263.111294:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509263.111299:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509263.111301:0:6542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788509263.111305:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509263.111309:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509263.111310:0:6542:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788509263.111313:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788509263.111314:0:6542:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788509263.111317:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509263.111319:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509263.111320:0:6542:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788509263.111322:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509263.111326:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509263.111327:0:6542:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788509263.111331:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788509263.111372:0:6542:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788509263.111425:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000963a2793 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6542:1875387796686080:0@lo:502: 00000100:00100000:1.0:1788509263.111505:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509263.111577:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8dfd2dc going to sleep for 11 seconds 00000100:00100000:2.0:1788509263.112190:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796686080 00000100:00100000:2.0:1788509263.112198:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796686080 00000100:00100000:2.0:1788509263.112248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788509263.112256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000275ee9d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:6542:x1875387796686080:12345-0@lo:502: 00000100:00100000:2.0:1788509263.112396:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000275ee9d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:6542:x1875387796686080:12345-0@lo:502: Request processed in 140us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509263.112404:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788509263.114016:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000963a2793 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6542:1875387796686080:0@lo:502: 00000020:01000000:1.0:1788509263.114069:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509263.114080:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509263.114082:0:6542:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788509263.114088:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788509263.114619:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788509263.114646:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788509263.114666:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.114676:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509263.114684:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd82e88800 from 1 10000000:01000000:2.0:1788509263.114687:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788509263.114724:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.114731:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.114740:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509263.114760:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686208:0@lo:101: 00000100:00100000:2.0:1788509263.115502:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.115653:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000160a9cc8 going to sleep for 11 seconds 00000100:00100000:0.0:1788509263.120296:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796686208 00000100:00100000:0.0:1788509263.120311:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796686208 00000100:00100000:0.0:1788509263.120465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788509263.120476:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b3a3b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:6497:x1875387796686208:12345-0@lo:101: 00010000:00010000:0.0:1788509263.120508:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509263.120695:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd40e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509263.120725:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd40e expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509263.120736:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd40e expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509263.120744:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be94638d, rc 0) 00000100:00100000:0.0:1788509263.121049:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b3a3b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:6497:x1875387796686208:12345-0@lo:101: Request processed in 576us (5550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509263.121056:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788509263.122434:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004737db14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686208:0@lo:101: 00010000:00010000:1.0:1788509263.122465:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509263.122478:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509263.124452:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686336:0@lo:256: 00000100:00100000:2.0:1788509263.124583:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.124695:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9201d28 going to sleep for 11 seconds 00000100:00100000:0.0:1788509263.126677:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796686336 00000100:00100000:0.0:1788509263.126690:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796686336 00000100:00100000:0.0:1788509263.126744:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788509263.126752:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000595a55d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:6497:x1875387796686336:12345-0@lo:256: 20000000:01000000:0.0:1788509263.126776:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788509263.126783:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788509263.126978:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000595a55d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:6497:x1875387796686336:12345-0@lo:256: Request processed in 226us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509263.126986:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788509263.128539:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686336:0@lo:256: 10000000:01000000:2.0:1788509263.129233:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788509263.129255:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.129267:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509263.129275:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd82e88800 from 1 10000000:01000000:2.0:1788509263.129278:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788509263.129314:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.129322:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.129331:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509263.129349:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686464:0@lo:101: 00000100:00100000:2.0:1788509263.129419:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.129461:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9201d28 going to sleep for 11 seconds 00000100:00100000:1.0:1788509263.129564:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796686464 00000100:00100000:1.0:1788509263.129571:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796686464 00000100:00100000:1.0:1788509263.129614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788509263.129621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000180c0da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:6497:x1875387796686464:12345-0@lo:101: 00010000:00010000:1.0:1788509263.129634:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509263.129646:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd41c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509263.129666:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd41c expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509263.129675:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd41c expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509263.129682:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c760d221, rc 0) 00000100:00100000:1.0:1788509263.129727:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000180c0da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:6497:x1875387796686464:12345-0@lo:101: Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509263.129733:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788509263.129963:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686464:0@lo:101: 00010000:00010000:2.0:1788509263.129977:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.131089:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509263.131176:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686592:0@lo:501: 00000100:00100000:2.0:1788509263.131227:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.131380:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9201d28 going to sleep for 11 seconds 00000100:00100000:1.0:1788509263.131481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796686592 00000100:00100000:1.0:1788509263.131489:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796686592 00000100:00100000:1.0:1788509263.131565:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788509263.131572:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aaf5742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:6497:x1875387796686592:12345-0@lo:501: 00000100:00100000:1.0:1788509263.131764:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aaf5742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:6497:x1875387796686592:12345-0@lo:501: Request processed in 191us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509263.131771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788509263.131997:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686592:0@lo:501: 00000100:00100000:2.0:1788509263.132029:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686720:0@lo:503: 00000100:00100000:2.0:1788509263.132086:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.132303:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9201d28 going to sleep for 11 seconds 00000100:00100000:1.0:1788509263.132349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796686720 00000100:00100000:1.0:1788509263.132354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796686720 00000100:00100000:0.0:1788509263.132414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788509263.132423:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c0f6f13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:6497:x1875387796686720:12345-0@lo:503: 00000040:00080000:0.0:1788509263.132459:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788509263.132507:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c0f6f13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:6497:x1875387796686720:12345-0@lo:503: Request processed in 86us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509263.132523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788509263.132681:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686720:0@lo:503: 00000040:00080000:2.0:1788509263.133591:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788509263.133801:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788509263.133822:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788509263.133840:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509263.133851:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509263.133923:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788509263.133926:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bcd82e88800 10000000:01000000:3.0:1788509263.133929:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bcd82e88800 10000000:01000000:3.0:1788509263.133933:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788509263.133939:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd82e88800 from 1 10000000:01000000:3.0:1788509263.133941:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509263.133989:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509263.134009:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509263.134019:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509263.134046:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686848:0@lo:101: 00000100:00100000:3.0:1788509263.134094:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509263.134122:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1d49aed going to sleep for 11 seconds 00000100:00100000:3.0:1788509263.134140:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796686848 00000100:00100000:3.0:1788509263.134146:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796686848 00000100:00100000:3.0:1788509263.134172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788509263.134179:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001061822a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:6497:x1875387796686848:12345-0@lo:101: 00010000:00010000:3.0:1788509263.134188:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509263.134200:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd42a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509263.134219:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd42a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509263.134228:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd42a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509263.134236:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005addc6c2, rc 0) 00000100:00100000:3.0:1788509263.134269:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001061822a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6497:x1875387796686848:12345-0@lo:101: Request processed in 90us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509263.134276:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788509263.134314:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686848:0@lo:101: 00010000:00010000:3.0:1788509263.134332:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509263.134339:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509263.134407:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686976:0@lo:501: 00000100:00100000:3.0:1788509263.134431:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509263.134443:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1d49aed going to sleep for 11 seconds 00000100:00100000:3.0:1788509263.134455:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796686976 00000100:00100000:3.0:1788509263.134458:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796686976 00000100:00100000:3.0:1788509263.134473:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788509263.134477:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b33b2cc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6497:x1875387796686976:12345-0@lo:501: 00000100:00100000:3.0:1788509263.134569:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b33b2cc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6497:x1875387796686976:12345-0@lo:501: Request processed in 91us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509263.134575:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788509263.134604:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796686976:0@lo:501: 00000100:00100000:3.0:1788509263.134627:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796687104:0@lo:503: 00000100:00100000:3.0:1788509263.134661:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509263.134674:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1d49aed going to sleep for 11 seconds 00000100:00100000:3.0:1788509263.134687:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796687104 00000100:00100000:3.0:1788509263.134690:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796687104 00000100:00100000:3.0:1788509263.134706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788509263.134710:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010fda4d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6497:x1875387796687104:12345-0@lo:503: 00000100:00100000:3.0:1788509263.134776:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010fda4d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6497:x1875387796687104:12345-0@lo:503: Request processed in 65us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509263.134782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788509263.134824:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796687104:0@lo:503: 00000100:00100000:2.0:1788509263.135351:0:6547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6547:1875387796687232:0@lo:502: 00000100:00100000:2.0:1788509263.135406:0:6547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.135430:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796687232 00000100:00100000:2.0:1788509263.135433:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796687232 00000100:00100000:2.0:1788509263.135454:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509263.135460:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068bf174d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6547:x1875387796687232:12345-0@lo:502: 00000100:00100000:2.0:1788509263.135546:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068bf174d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6547:x1875387796687232:12345-0@lo:502: Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509263.135552:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509263.135581:0:6547:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2178fb7 going to sleep for 11 seconds 00000100:00100000:2.0:1788509263.135596:0:6547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6547:1875387796687232:0@lo:502: 00000020:01000004:2.0:1788509263.135652:0:6547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788509263.135671:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003899a98c) 00000020:00000080:2.0:1788509263.135687:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788509263.135749:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b0987b76 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788509263.135753:0:6547:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b0987b76 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788509263.135756:0:6547:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b0987b76 4 00010000:00080000:2.0:1788509263.135800:0:6547:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ace65979@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788509263.138290:0:6547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788509263.139736:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788509263.140568:0:6547:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788509263.140585:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe5156b86310dd43f 00000100:00080000:2.0:1788509263.140597:0:6547:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788509263.140603:0:6547:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ace65979 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509263.140641:0:6547:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000309b1e6b x1875387796687360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788509263.140672:0:6547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788509263.141307:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796687360:0@lo:38: 00000100:00100000:0.0:1788509263.141387:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509263.144916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796687360 00000100:00100000:3.0:1788509263.144930:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796687360 00000100:00100000:3.0:1788509263.144976:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509263.144983:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ca48ab4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875387796687360:12345-0@lo:38: 00000100:00100000:3.0:1788509263.145083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ca48ab4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875387796687360:12345-0@lo:38: Request processed in 99us (3696us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788509263.145091:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788509263.145337:0:6547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c2d644a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6547:1875387796687488:0@lo:502: 00000100:00100000:2.0:1788509263.145405:0:6547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.145429:0:6547:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010fa3b37 going to sleep for 11 seconds 00000100:00100000:1.0:1788509263.145589:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796687488 00000100:00100000:1.0:1788509263.145594:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796687488 00000100:00100000:1.0:1788509263.145624:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788509263.145630:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f265b5f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6547:x1875387796687488:12345-0@lo:502: 00000100:00100000:1.0:1788509263.145746:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f265b5f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6547:x1875387796687488:12345-0@lo:502: Request processed in 116us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509263.145753:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788509263.146138:0:6547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c2d644a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6547:1875387796687488:0@lo:502: 00000040:00080000:2.0:1788509263.146165:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788509263.146453:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788509263.146476:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788509263.146495:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509263.146506:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788509263.146547:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788509263.146549:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788509263.146551:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509263.146552:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509263.146553:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509263.146554:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509263.146555:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509263.146557:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788509263.146558:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788509263.146559:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788509263.146560:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509263.146562:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788509263.146564:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788509263.146567:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788509263.146568:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788509263.146569:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509263.146570:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509263.146571:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509263.146573:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509263.146578:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509263.146579:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788509263.146579:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788509263.146580:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788509263.146581:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509263.146582:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788509263.146599:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788509263.146610:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000963a2793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796687616:0@lo:253: 00000100:00100000:1.0:1788509263.146652:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509263.146694:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000119314b2 going to sleep for 11 seconds 00000100:00100000:3.0:1788509263.146738:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796687616 00000100:00100000:3.0:1788509263.146745:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796687616 00000100:00100000:3.0:1788509263.146779:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788509263.146795:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006046a594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6497:x1875387796687616:12345-0@lo:253: 20000000:01000000:3.0:1788509263.146964:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788509263.146977:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788509263.147585:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509263.147593:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000ace65979 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509263.147598:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788509263.147601:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000309b1e6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796687360:0@lo:38: 20000000:01000000:3.0:1788509263.158447:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788509263.158467:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788509263.158561:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788509263.158567:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788509263.158586:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.158606:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd40e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.158614:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.158665:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd40e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.158692:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd40e expref: 12 pid: 6513 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509263.158706:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c2d644a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796687744:0@lo:104: 00000100:00100000:2.0:1788509263.158765:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.158988:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010fa3b37 going to sleep for 11 seconds 00000100:00100000:1.0:1788509263.159213:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796687744 00000100:00100000:1.0:1788509263.159220:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796687744 00000100:00100000:1.0:1788509263.159270:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788509263.159278:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029862224 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6536:x1875387796687744:12345-0@lo:104: 00010000:00010000:1.0:1788509263.159291:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509263.159359:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509263.159373:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029862224 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6536:x1875387796687744:12345-0@lo:104: Request processed in 89us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509263.159381:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509263.159452:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c2d644a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796687744:0@lo:104: 00010000:00010000:3.0:1788509263.159475:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.159572:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509263.159577:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.159584:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022c36a7e already unused, calling callback (0000000098267291) 10000000:00010000:2.0:1788509263.159587:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.159594:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509263.159601:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509263.159607:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509263.159747:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.159755:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509263.159793:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.159817:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 0000000022c36a7e/0xe5156b86310dd40e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd415 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.159842:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509263.159844:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509263.159846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509263.160106:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509263.160118:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e916326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796687872:0@lo:103: 00000100:00100000:0.0:1788509263.160157:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509263.160234:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796687872 00000100:00100000:2.0:1788509263.160239:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796687872 00010000:00010000:2.0:1788509263.160258:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd40e expref: 13 pid: 6513 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509263.160290:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788509263.160297:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec61f1cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:3644:x1875387796687872:12345-0@lo:103: 00010000:00010000:2.0:1788509263.160307:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509263.160311:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd40e expref: 13 pid: 6513 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160320:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd40e expref: 13 pid: 6513 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160332:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be94638d/0xe5156b86310dd415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd40e expref: 13 pid: 6513 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160345:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160352:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788509263.160386:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001819625s 00010000:00010000:2.0:1788509263.160390:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160397:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160402:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160408:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160413:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f825a6e already unused, calling callback (00000000b73d62c5) 00010000:00010000:2.0:1788509263.160416:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160422:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160437:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160447:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509263.160479:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec61f1cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:3644:x1875387796687872:12345-0@lo:103: Request processed in 184us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509263.160485:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788509263.160511:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e916326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796687872:0@lo:103: 00010000:00010000:2.0:1788509263.160528:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160540:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509263.160544:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009f825a6e/0xe5156b86310dd446 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509263.161602:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006046a594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:6497:x1875387796687616:12345-0@lo:253: Request processed in 14813us (14946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509263.161613:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509263.161728:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000963a2793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6497:1875387796687616:0@lo:253: 10000000:01000000:2.0:1788509263.161742:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788509263.161745:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788509263.161747:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788509263.161748:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509263.161749:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509263.161750:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509263.161751:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509263.161752:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788509263.161753:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788509263.161754:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788509263.161755:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788509263.161757:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509263.161758:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788509263.161771:0:6497:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788509263.171846:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788509263.172074:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788509263.172322:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788509263.173622:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788509263.174174:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788509263.174328:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788509263.175246:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788509263.175483:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788509263.175667:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788509263.176185:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788509263.176492:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788509263.176636:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788509263.180162:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788509263.193811:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788509263.194107:0:6552:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788509263.194111:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788509263.195027:0:6553:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788509263.201782:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788509263.202081:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788509263.202543:0:6497:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788509263.202550:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788509263.202658:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509263.207791:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788509263.210014:0:6553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509263.210017:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788509263.210104:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788509263.210517:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788509263.212185:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1788509263.217316:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788509263.217479:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788509263.217632:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788509263.217769:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788509263.217937:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788509263.218095:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788509263.218244:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788509263.218372:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788509263.218530:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788509263.218676:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788509263.218820:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788509263.218983:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000040:00080000:2.0:1788509263.220794:0:6553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788509263.220880:0:6553:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788509263.220885:0:6553:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788509263.228473:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788509263.228747:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788509263.230631:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788509263.230802:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788509263.235124:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788509263.235658:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788509263.236652:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788509263.237634:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788509263.239889:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788509263.241608:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788509263.242625:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788509263.248119:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788509263.248467:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788509263.248625:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788509263.248791:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788509263.248972:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788509263.249127:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788509263.249276:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788509263.249406:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788509263.249537:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788509263.249732:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788509263.254080:0:6497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788509263.254122:0:6497:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb93b41a4b988 00100000:10000000:2.0:1788509263.254130:0:6497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788509263.254774:0:6497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788509263.254787:0:6497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788509263.254807:0:6497:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788509263.254835:0:6497:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788509263.261536:0:6497:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509263.261767:0:6497:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788509263.702658:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509264.733162:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509265.752350:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509266.774120:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788509267.180562:0:6798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788509267.798098:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788509267.961663:0:6850:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509267.962206:0:6850:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1788509268.186051:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788509268.186060:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788509268.186062:0:36:0:(import.c:65:import_set_state_nolock()) 00000000ace65979 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509268.186073:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ace65979 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509268.186094:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000359de3aa x1875387796688128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788509268.186182:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788509268.186196:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b722b5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796688000:0@lo:400: 00000100:00100000:3.0:1788509268.186262:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509268.186421:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000359de3aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796688128:0@lo:38: 00000100:00100000:0.0:1788509268.186468:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509268.186811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796688128 00000100:00100000:2.0:1788509268.186820:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796688128 00000100:00100000:2.0:1788509268.186861:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509268.186868:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022ec53d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796688128:12345-0@lo:38: 00010000:00080000:2.0:1788509268.186893:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:2.0:1788509268.186967:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe5156b86310dd44d 00000004:00100000:2.0:1788509268.187023:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788509268.187148:0:6522:0:(import.c:65:import_set_state_nolock()) 0000000071d2930e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509268.187214:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022ec53d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875387796688128:12345-0@lo:38: Request processed in 345us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509268.187222:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788509268.187453:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000359de3aa x1875387796688128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788509268.187470:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788509268.187481:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788509268.187486:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788509268.187488:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000ace65979 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788509268.187497:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000359de3aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796688128:0@lo:38: 00000100:00100000:1.0:1788509268.187567:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796688000 00000100:00100000:1.0:1788509268.187573:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796688000 00000100:00100000:1.0:1788509268.187614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788509268.187621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e49fed50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:3647:x1875387796688000:12345-0@lo:400: 00000100:00100000:1.0:1788509268.187681:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e49fed50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:3647:x1875387796688000:12345-0@lo:400: Request processed in 62us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509268.187696:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788509268.187797:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b722b5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796688000:0@lo:400: 00010000:00010000:1.0:1788509268.831367:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509269.846095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509270.890167:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788509271.027677:0:6951:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509271.027833:0:6951:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788509271.253999:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788509271.254006:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd82e88800 from 3 10000000:01000000:3.0:1788509271.254011:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788509271.254056:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509271.254081:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509271.254090:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509271.254110:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796688256:0@lo:101: 00000100:00100000:3.0:1788509271.254170:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509271.254222:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c3ca901 going to sleep for 11 seconds 00000100:00100000:1.0:1788509271.254294:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796688256 00000100:00100000:1.0:1788509271.254302:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796688256 00000100:00100000:1.0:1788509271.254357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788509271.254365:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a346d7e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:6517:x1875387796688256:12345-0@lo:101: 00010000:00010000:1.0:1788509271.254378:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509271.254389:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd454 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509271.254411:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd454 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509271.254421:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd454 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509271.254431:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c9b02fe, rc 0) 00000100:00100000:1.0:1788509271.254759:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a346d7e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6517:x1875387796688256:12345-0@lo:101: Request processed in 395us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509271.254766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788509271.254835:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796688256:0@lo:101: 00010000:00010000:3.0:1788509271.254850:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509271.254857:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509271.257008:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796688384:0@lo:256: 00000100:00100000:3.0:1788509271.257079:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509271.257149:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c3ca901 going to sleep for 11 seconds 00000100:00100000:0.0:1788509271.257198:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796688384 00000100:00100000:0.0:1788509271.257205:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796688384 00000100:00100000:0.0:1788509271.257276:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788509271.257284:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d8dd6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6517:x1875387796688384:12345-0@lo:256: 20000000:01000000:0.0:1788509271.257304:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788509271.257324:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788509271.257327:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788509271.257452:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d8dd6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:6517:x1875387796688384:12345-0@lo:256: Request processed in 168us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509271.257459:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788509271.257527:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796688384:0@lo:256: 10000000:01000000:3.0:1788509271.257569:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788509271.257578:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509271.257587:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509271.899036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509272.919292:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509273.305098:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796688512:0@lo:400: 00000100:00100000:0.0:1788509273.305167:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509273.305861:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796688512 00000100:00100000:0.0:1788509273.305869:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796688512 00000100:00100000:2.0:1788509273.307328:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a26040ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796688640:0@lo:400: 00000100:00100000:2.0:1788509273.307451:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509273.308222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788509273.308238:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006676ba5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:3647:x1875387796688512:12345-0@lo:400: 00000100:00100000:0.0:1788509273.308320:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006676ba5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:3647:x1875387796688512:12345-0@lo:400: Request processed in 82us (3147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509273.308327:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788509273.308390:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796688640 00000100:00100000:0.0:1788509273.308397:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796688640 00000100:00100000:0.0:1788509273.308429:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509273.308435:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e916326 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796688640:12345-0@lo:400: 00000100:00100000:0.0:1788509273.308471:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e916326 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796688640:12345-0@lo:400: Request processed in 37us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509273.308477:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509273.308620:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796688512:0@lo:400: 00010000:00080000:2.0:1788509273.310730:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a26040ab x1875387796688640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509273.310749:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a26040ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796688640:0@lo:400: 00010000:00010000:1.0:1788509273.943016:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509274.967000:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509275.991006:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509277.022004:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509278.038261:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509278.422113:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509278.422181:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796688896:0@lo:400: 00000100:00100000:3.0:1788509278.422255:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509278.422320:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796688896 00000100:00100000:3.0:1788509278.422328:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796688896 00000100:00100000:3.0:1788509278.422369:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509278.422376:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000710ea95e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796688896:12345-0@lo:400: 00000100:00100000:3.0:1788509278.422422:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000710ea95e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796688896:12345-0@lo:400: Request processed in 46us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509278.422430:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788509278.422637:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000031567dca x1875387796688896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509278.422651:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796688896:0@lo:400: 00000100:00100000:2.0:1788509278.425663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d30640f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796688768:0@lo:400: 00000100:00100000:2.0:1788509278.425743:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509278.428631:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796688768 00000100:00100000:0.0:1788509278.428653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796688768 00000100:00100000:0.0:1788509278.428748:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788509278.428756:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff34139e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:3644:x1875387796688768:12345-0@lo:400: 00000100:00100000:0.0:1788509278.428851:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff34139e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:3644:x1875387796688768:12345-0@lo:400: Request processed in 96us (3108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509278.428858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788509278.428958:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d30640f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796688768:0@lo:400: 00010000:00010000:0.0:1788509279.071323:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509280.102451:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509281.110424:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788509281.604198:0:7450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788509281.604204:0:7450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788509281.604205:0:7450:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788509281.608251:0:7450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cca53e81 00000020:01000004:2.0:1788509281.608286:0:7450:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788509281.608302:0:7450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788509281.608332:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000097f76805) 00000020:00000080:2.0:1788509281.608353:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788509281.729567:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788509281.729637:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788509281.775607:0:7450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788509281.775858:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788509281.775943:0:7450:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788509281.775956:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310dd469 00000020:01000004:2.0:1788509281.775962:0:7450:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788509281.775982:0:7450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788509281.775986:0:7450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788509281.775991:0:7450:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788509281.776033:0:7450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788509281.776043:0:7450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788509281.823752:0:7450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788509281.823791:0:7450:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788509281.823796:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788509281.823798:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788509281.823799:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509281.823801:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509281.823802:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509281.823803:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509281.823804:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509281.823805:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788509281.823807:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788509281.823808:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509281.823810:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788509281.823813:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788509281.823815:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788509281.823816:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788509281.823817:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509281.823818:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509281.823819:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509281.823820:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509281.823821:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509281.823822:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788509281.823823:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788509281.823824:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509281.823825:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788509281.823850:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788509281.823869:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796689024:0@lo:253: 00000100:00100000:1.0:1788509281.824080:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.824175:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5c85fc6 going to sleep for 11 seconds 00000100:00100000:2.0:1788509281.824219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796689024 00000100:00100000:2.0:1788509281.824228:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796689024 00000100:00100000:2.0:1788509281.824397:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509281.824407:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d923bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796689024:12345-0@lo:253: 20000000:01000000:2.0:1788509281.824441:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788509281.824445:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788509281.824450:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788509281.824454:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788509281.824491:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788509281.824706:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788509281.824832:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788509281.824846:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788509281.824864:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788509281.824880:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788509281.824937:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788509281.824996:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788509281.825004:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788509281.825018:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788509281.825024:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788509281.825036:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788509281.825040:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788509281.825053:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788509281.825066:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788509281.825162:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788509281.825171:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788509281.825184:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788509281.825191:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788509281.825202:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788509281.825207:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788509281.825218:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788509281.825231:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788509281.825534:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788509281.825559:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788509281.825569:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788509281.825638:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788509281.825646:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788509281.825658:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788509281.825688:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788509281.825708:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788509281.825713:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788509281.825723:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788509281.825739:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788509281.825743:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788509281.825762:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788509281.825769:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788509281.826886:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788509281.827138:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788509281.827159:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:2.0:1788509281.827161:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788509281.827172:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788509281.827176:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788509281.827186:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788509281.827190:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788509281.827202:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788509281.827208:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788509281.827218:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788509281.827229:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788509281.827281:0:6514:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788509281.827288:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788509281.827681:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788509281.827831:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788509281.827846:0:6514:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:1.0:1788509281.827847:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788509281.827861:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788509281.827867:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788509281.827879:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788509281.827885:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788509281.827944:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788509281.827954:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788509281.827966:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788509281.827980:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788509281.828000:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788509281.828002:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788509281.828006:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788509281.828050:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788509281.828051:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788509281.828644:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788509281.828668:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788509281.828679:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1788509281.828824:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788509281.828860:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788509281.828876:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1788509281.828885:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788509281.828887:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788509281.829442:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788509281.829460:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788509281.829472:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788509281.829597:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788509281.829613:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788509281.829624:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788509281.829631:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788509281.829633:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788509281.830397:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788509281.830422:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788509281.830432:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788509281.830565:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788509281.830583:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788509281.830612:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788509281.830624:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788509281.830626:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788509281.830631:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788509281.830637:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788509281.830883:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788509281.831550:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788509281.840760:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788509281.840818:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.840842:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd39e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.840850:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.840873:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd42a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.840880:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.841092:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd42a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.841106:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd42a expref: 12 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.841120:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f581bbee pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1875387796689152:0@lo:104: 00000100:00100000:1.0:1788509281.841185:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509281.841277:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.841284:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 12 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.841293:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000696c29a8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1875387796689280:0@lo:104: 00000100:00100000:1.0:1788509281.841310:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509281.843204:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd39e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.843221:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd39e expref: 12 pid: 6514 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.843233:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ea1983d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1875387796689408:0@lo:104: 00000100:00100000:3.0:1788509281.844414:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796689152 00000100:00100000:3.0:1788509281.844425:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796689152 00000100:00100000:3.0:1788509281.844467:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796689280 00000100:00100000:3.0:1788509281.844470:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796689280 00000100:00100000:3.0:1788509281.844484:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509281.844491:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000659b71b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6514:x1875387796689152:12345-0@lo:104: 00000100:00100000:1.0:1788509281.844501:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788509281.844507:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.844535:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2049721 going to sleep for 11 seconds 00010000:00010000:3.0:1788509281.844622:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509281.844628:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000659b71b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6514:x1875387796689152:12345-0@lo:104: Request processed in 138us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509281.844636:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509281.844667:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796689408 00000100:00100000:3.0:1788509281.844671:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796689408 00000100:00100000:3.0:1788509281.844696:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509281.844701:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d1090b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6514:x1875387796689280:12345-0@lo:104: 00010000:00010000:3.0:1788509281.844707:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.844951:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509281.844956:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.844964:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b06bbaf already unused, calling callback (0000000098267291) 10000000:00010000:0.0:1788509281.844968:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.844977:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509281.844985:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509281.844992:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509281.845025:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845031:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509281.845057:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845064:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000001b06bbaf/0xe5156b86310dd42a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd431 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845077:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509281.845078:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845084:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000086fb7f7a already unused, calling callback (0000000098267291) 10000000:00010000:0.0:1788509281.845086:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845092:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509281.845097:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509281.845103:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509281.845114:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845120:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509281.845130:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845136:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 0000000086fb7f7a/0xe5156b86310dd3ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd3c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845144:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509281.845149:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509281.845151:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509281.845171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee0b13ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796689536:0@lo:103: 00000100:00100000:0.0:1788509281.845203:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509281.845241:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcb92a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796689664:0@lo:103: 00000100:00100000:0.0:1788509281.845264:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509281.845297:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796689536 00000100:00100000:0.0:1788509281.845302:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796689536 00010000:00010000:0.0:1788509281.845320:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd42a expref: 13 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509281.845340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796689664 00000100:00100000:0.0:1788509281.845343:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796689664 00010000:00010000:0.0:1788509281.845353:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 14 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509281.845364:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509281.845370:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060752507 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:3647:x1875387796689536:12345-0@lo:103: 00000100:00100000:1.0:1788509281.845372:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f581bbee pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1875387796689152:0@lo:104: 00010000:00010000:0.0:1788509281.845380:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788509281.845381:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000696c29a8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1875387796689280:0@lo:104: 00010000:00010000:0.0:1788509281.845384:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd42a expref: 14 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845394:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd42a expref: 14 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845413:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005addc6c2/0xe5156b86310dd431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd42a expref: 14 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845427:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509281.845461:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060752507 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:3647:x1875387796689536:12345-0@lo:103: Request processed in 92us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509281.845473:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509281.845487:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509281.845492:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000444c1a60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:3644:x1875387796689664:12345-0@lo:103: 00010000:00010000:0.0:1788509281.845499:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509281.845502:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 12 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845510:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 12 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845519:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008ae0549/0xe5156b86310dd3c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd3ba expref: 12 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.845527:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509281.845530:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee0b13ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796689536:0@lo:103: 00000100:00100000:0.0:1788509281.845550:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000444c1a60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:3644:x1875387796689664:12345-0@lo:103: Request processed in 59us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509281.845556:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509281.845575:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcb92a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796689664:0@lo:103: 00010000:00010000:3.0:1788509281.845638:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788509281.845644:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d1090b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6514:x1875387796689280:12345-0@lo:104: Request processed in 944us (4333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509281.845836:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509281.845853:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509281.845860:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fecfb880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6514:x1875387796689408:12345-0@lo:104: 00010000:00010000:3.0:1788509281.845869:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509281.845937:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509281.845942:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fecfb880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6514:x1875387796689408:12345-0@lo:104: Request processed in 84us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509281.845945:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ea1983d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1875387796689408:0@lo:104: 00000100:00100000:3.0:1788509281.845948:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788509281.845963:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846012:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509281.846016:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846023:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ce896ab9 already unused, calling callback (0000000098267291) 10000000:00010000:0.0:1788509281.846025:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846032:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509281.846050:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509281.846060:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509281.846088:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846095:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509281.846119:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846125:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000ce896ab9/0xe5156b86310dd39e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd3a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.846128:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509281.846136:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcb92a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796689792:0@lo:103: 00010000:00010000:0.0:1788509281.846138:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509281.846139:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509281.846141:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509281.846146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509281.846162:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509281.846335:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796689792 00000100:00100000:0.0:1788509281.846340:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796689792 00010000:00010000:0.0:1788509281.846358:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd39e expref: 11 pid: 6514 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509281.846472:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788509281.846480:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ea1983d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:3644:x1875387796689792:12345-0@lo:103: 00010000:00010000:0.0:1788509281.846488:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509281.846492:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd39e expref: 11 pid: 6514 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846513:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd39e expref: 11 pid: 6514 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846523:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000623b06ef/0xe5156b86310dd3a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd39e expref: 11 pid: 6514 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846535:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846543:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846556:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846563:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846568:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846574:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846579:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee16fef4 already unused, calling callback (00000000b73d62c5) 00010000:00010000:0.0:1788509281.846582:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846589:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846621:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.846632:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509281.846734:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.846743:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.846748:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee16fef4/0xe5156b86310dd470 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788509281.846765:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788509281.846828:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ea1983d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:3644:x1875387796689792:12345-0@lo:103: Request processed in 349us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509281.846834:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509281.847475:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcb92a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796689792:0@lo:103: 00000100:00100000:2.0:1788509281.853195:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d923bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:7450:x1875387796689024:12345-0@lo:253: Request processed in 28783us (29108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509281.853212:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788509281.853377:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796689024:0@lo:253: 10000000:01000000:1.0:1788509281.853402:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788509281.853406:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788509281.853408:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788509281.853410:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509281.853411:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788509281.853413:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509281.853502:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509281.853503:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509281.853505:0:7450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788509281.853506:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509281.853508:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788509281.853535:0:7450:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cca53e81 from lustre-MDT0001 10000000:01000000:1.0:1788509281.853582:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788509281.853584:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788509281.853593:0:7450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bcd9e5d99c0 local copy 10000000:01000000:1.0:1788509281.853598:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788509281.853652:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.853664:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.853674:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.853697:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796689920:0@lo:101: 00000100:00100000:1.0:1788509281.853763:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.853878:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1a05cf3 going to sleep for 11 seconds 00000100:00100000:0.0:1788509281.869999:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796689920 00000100:00100000:0.0:1788509281.870016:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796689920 00000100:00100000:2.0:1788509281.870629:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788509281.870646:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5c7bf3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+9:7450:x1875387796689920:12345-0@lo:101: 00010000:00010000:2.0:1788509281.870673:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509281.870700:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd47e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd477 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509281.870740:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd47e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd477 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509281.870753:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd47e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd477 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509281.870765:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd65a62d, rc 0) 00000100:00100000:2.0:1788509281.870879:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5c7bf3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:7450:x1875387796689920:12345-0@lo:101: Request processed in 236us (17116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509281.870888:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788509281.871412:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796689920:0@lo:101: 00010000:00010000:1.0:1788509281.871443:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.871455:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.871569:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690048:0@lo:501: 00000100:00100000:1.0:1788509281.871625:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.872013:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1a05cf3 going to sleep for 11 seconds 00000100:00100000:2.0:1788509281.872071:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796690048 00000100:00100000:2.0:1788509281.872078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796690048 00000100:00100000:2.0:1788509281.872121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788509281.872136:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c703ddd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:7450:x1875387796690048:12345-0@lo:501: 00000100:00100000:2.0:1788509281.872261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c703ddd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:7450:x1875387796690048:12345-0@lo:501: Request processed in 126us (635us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509281.872269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788509281.872333:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690048:0@lo:501: 10000000:01000000:1.0:1788509281.872346:0:7450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788509281.872366:0:7450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788509281.872373:0:7450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.872382:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.872389:0:7450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.872405:0:7450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509281.872427:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1788509281.872434:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bcdbbf0f800 00010000:00010000:0.0:1788509281.872439:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509281.872441:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788509281.872454:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8bcd9e5d99c0 00010000:00010000:0.0:1788509281.872459:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee16fef4 already unused, calling callback (0000000098267291) 10000000:01000000:1.0:1788509281.872460:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:00010000:0.0:1788509281.872466:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509281.872469:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8bcd9e5d99c0 from 1 10000000:01000000:1.0:1788509281.872480:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788509281.872492:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509281.872502:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509281.872508:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788509281.872514:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000006698b84c/0xe5156b86310dd485 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.872524:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000006698b84c/0xe5156b86310dd485 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.872533:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000006698b84c/0xe5156b86310dd485 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.872549:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.872551:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690176:0@lo:101: 00010000:00010000:0.0:1788509281.872563:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509281.872602:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.872629:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd47e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509281.872654:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788509281.872655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509281.872659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509281.872662:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509281.872673:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f6c1f501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796690304:0@lo:103: 00000100:00100000:2.0:1788509281.872703:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.873212:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.873279:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2049721 going to sleep for 11 seconds 00000100:00100000:2.0:1788509281.873323:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796690176 00000100:00100000:2.0:1788509281.873329:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796690176 00000100:00100000:2.0:1788509281.873429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509281.873438:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3979326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+10:7450:x1875387796690176:12345-0@lo:101: 00010000:00010000:2.0:1788509281.873449:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509281.873464:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a34ff2c/0xe5156b86310dd48c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd485 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509281.873482:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a34ff2c/0xe5156b86310dd48c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd485 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509281.873492:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a34ff2c/0xe5156b86310dd48c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd485 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509281.873500:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a34ff2c, rc 0) 00000100:00100000:2.0:1788509281.873589:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3979326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:7450:x1875387796690176:12345-0@lo:101: Request processed in 153us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509281.873594:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788509281.874017:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690176:0@lo:101: 00010000:00010000:1.0:1788509281.874033:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000006698b84c/0xe5156b86310dd485 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd48c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.874041:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000006698b84c/0xe5156b86310dd485 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd48c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509281.874061:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788509281.874072:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000006698b84c/0xe5156b86310dd485 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd48c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.874078:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000006698b84c/0xe5156b86310dd485 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd48c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509281.874088:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8bcdbbf0f800 10000000:01000000:1.0:1788509281.874093:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788509281.874096:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8bcdbbf0f800 from 1 10000000:01000000:1.0:1788509281.874099:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788509281.874117:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c3d157b4/0xe5156b86310dd493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.874123:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000c3d157b4/0xe5156b86310dd493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.874130:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000c3d157b4/0xe5156b86310dd493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.874144:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690432:0@lo:101: 00000100:00100000:1.0:1788509281.874187:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.874216:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2049721 going to sleep for 11 seconds 00000100:00100000:1.0:1788509281.877200:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796690432 00000100:00100000:1.0:1788509281.877217:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796690432 00000100:00100000:1.0:1788509281.877277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788509281.877286:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9ea70ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+11:7450:x1875387796690432:12345-0@lo:101: 00010000:00010000:1.0:1788509281.877303:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509281.877584:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007871b89f/0xe5156b86310dd49a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd493 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.877674:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007871b89f/0xe5156b86310dd49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd493 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.877686:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007871b89f/0xe5156b86310dd49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd493 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.877695:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007871b89f, rc 0) 00000100:00100000:1.0:1788509281.877794:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9ea70ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796690432:12345-0@lo:101: Request processed in 509us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509281.877801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788509281.877853:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690432:0@lo:101: 00010000:00010000:1.0:1788509281.877870:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000c3d157b4/0xe5156b86310dd493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.877878:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000c3d157b4/0xe5156b86310dd493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509281.877895:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788509281.877936:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c3d157b4/0xe5156b86310dd493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.877957:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000c3d157b4/0xe5156b86310dd493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509281.877966:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788509281.877970:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788509281.877978:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8bcdbbf0f800 10000000:01000000:1.0:1788509281.877981:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788509281.877986:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788509281.877990:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788509281.878016:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000b79bac04/0xe5156b86310dd4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.878023:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000b79bac04/0xe5156b86310dd4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.878029:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000b79bac04/0xe5156b86310dd4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.878046:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690560:0@lo:101: 00000100:00100000:0.0:1788509281.878224:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796690304 00000100:00100000:0.0:1788509281.878356:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796690304 00000100:00100000:1.0:1788509281.878427:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509281.878445:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796690560 00000100:00100000:3.0:1788509281.878461:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796690560 00000100:00100000:1.0:1788509281.878467:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2049721 going to sleep for 11 seconds 00000100:00100000:3.0:1788509281.878506:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509281.878515:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000879d8c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:7450:x1875387796690560:12345-0@lo:101: 00010000:00010000:3.0:1788509281.878528:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788509281.878539:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788509281.878543:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fbb1f12b/0xe5156b86310dd4a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd4a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509281.878557:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075d4e6c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:3647:x1875387796690304:12345-0@lo:103: 00010000:00010000:3.0:1788509281.878572:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fbb1f12b/0xe5156b86310dd4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.878579:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509281.878587:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fbb1f12b/0xe5156b86310dd4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509281.878603:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fbb1f12b, rc 0) 00010000:00010000:0.0:1788509281.878605:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd47e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd477 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509281.878628:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509281.878685:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000879d8c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:7450:x1875387796690560:12345-0@lo:101: Request processed in 170us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509281.878696:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788509281.878713:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075d4e6c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:3647:x1875387796690304:12345-0@lo:103: Request processed in 162us (6007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509281.878723:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788509281.878827:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690560:0@lo:101: 00010000:00010000:1.0:1788509281.878841:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000b79bac04/0xe5156b86310dd4a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509281.878849:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000b79bac04/0xe5156b86310dd4a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509281.878980:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690688:0@lo:501: 00000100:00100000:1.0:1788509281.879011:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.879036:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2049721 going to sleep for 11 seconds 00000100:00100000:1.0:1788509281.879051:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796690688 00000100:00100000:1.0:1788509281.879055:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796690688 00000100:00100000:1.0:1788509281.879078:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788509281.879084:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d59fa43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796690688:12345-0@lo:501: 00000100:00100000:1.0:1788509281.879181:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d59fa43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796690688:12345-0@lo:501: Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509281.879187:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788509281.879212:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690688:0@lo:501: 00000100:00100000:1.0:1788509281.879237:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690816:0@lo:503: 00000100:00100000:1.0:1788509281.879276:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.879286:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2049721 going to sleep for 11 seconds 00000100:00100000:1.0:1788509281.879304:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796690816 00000100:00100000:1.0:1788509281.879307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796690816 00000100:00100000:1.0:1788509281.879323:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788509281.879328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9581ace pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796690816:12345-0@lo:503: 00000100:00100000:1.0:1788509281.879403:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9581ace pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796690816:12345-0@lo:503: Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509281.879409:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788509281.879441:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690816:0@lo:503: 00000040:00080000:1.0:1788509281.879678:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788509281.879745:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690944:0@lo:502: 00000100:00100000:1.0:1788509281.879784:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.879794:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f7ce513 going to sleep for 11 seconds 00000100:00100000:1.0:1788509281.879812:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796690944 00000100:00100000:1.0:1788509281.879816:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796690944 00000100:00100000:1.0:1788509281.879831:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788509281.879836:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d56ffdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796690944:12345-0@lo:502: 00000100:00100000:1.0:1788509281.879943:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d56ffdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796690944:12345-0@lo:502: Request processed in 107us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509281.879950:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788509281.879982:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796690944:0@lo:502: 00000040:00080000:1.0:1788509281.880158:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788509281.880184:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788509281.880197:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788509281.880225:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788509281.880241:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788509281.880253:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788509281.880264:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788509281.880275:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788509281.880287:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788509281.880299:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788509281.880311:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788509281.880323:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788509281.880336:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788509281.880348:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788509281.880359:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788509281.880371:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788509281.880383:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788509281.880393:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788509281.880405:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788509281.880428:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788509281.880450:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788509281.880463:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788509281.880474:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788509281.880496:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691072:0@lo:502: 00000100:00100000:1.0:1788509281.880533:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509281.880555:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f7ce513 going to sleep for 11 seconds 00000100:00100000:1.0:1788509281.880579:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796691072 00000100:00100000:1.0:1788509281.880583:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796691072 00000100:00100000:1.0:1788509281.880602:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788509281.880607:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095345172 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796691072:12345-0@lo:502: 00000100:00100000:1.0:1788509281.880678:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095345172 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796691072:12345-0@lo:502: Request processed in 71us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509281.880685:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788509281.880718:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691072:0@lo:502: 00000040:00080000:1.0:1788509281.880753:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788509281.880760:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000100:00100000:2.0:1788509281.887117:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f6c1f501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796690304:0@lo:103: 00000020:01000000:0.0:1788509281.887777:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509281.887795:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509281.887798:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788509281.887805:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788509281.887809:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788509281.887828:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000084a6c5d7) 00000020:00000080:0.0:1788509281.887855:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788509281.887862:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788509281.888035:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788509281.888055:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310dd4b6 00000020:00000080:2.0:1788509281.893114:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788509281.893137:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509281.893330:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509281.893340:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788509281.893354:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509281.893364:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509281.893365:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788509281.893372:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788509281.893413:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000005b19b309) 00000020:00000080:3.0:1788509281.893441:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788509281.893447:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788509281.893449:0:7462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788509281.893452:0:7462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788509281.893459:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788509281.893553:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cca53e81 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788509281.893566:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000012e94a7d) 00000020:00000080:3.0:1788509281.893582:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788509281.893674:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788509281.893682:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310dd4cb 00000020:00000080:3.0:1788509281.893842:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788509281.893849:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788509281.893854:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe5156b86310dd4d2 00080000:01000000:3.0:1788509281.893861:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788509281.893865:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310dd4d9 00080000:10000000:3.0:1788509281.894305:0:7462:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788509281.894427:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788509282.041225:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788509282.041617:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788509282.045021:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788509282.045359:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788509282.071133:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788509282.071146:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509282.071153:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509282.071155:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788509282.071159:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509282.071165:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509282.071167:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788509282.071170:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788509282.071175:0:7462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:1.0:1788509282.071202:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509282.071226:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000eebacd2a) 00000020:00000080:1.0:1788509282.071260:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788509282.071267:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788509282.071337:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788509282.071348:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788509282.071355:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310dd4e7 00010000:00080000:1.0:1788509282.071386:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002e8fdb53@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509282.084855:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788509282.089957:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788509282.089973:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788509282.090008:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788509282.090029:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310dd4ee 00000100:00080000:3.0:1788509282.090039:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788509282.090044:0:7462:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000002e8fdb53 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509282.090079:0:7462:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009d30640f x1875387796691200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788509282.090108:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788509282.090165:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509282.090169:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509282.090170:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788509282.090173:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788509282.090175:0:7462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788509282.090177:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788509282.090179:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788509282.090180:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788509282.090182:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509282.090183:0:7462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788509282.090186:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509282.090190:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509282.090191:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788509282.090208:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788509282.090237:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788509282.090250:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509282.090253:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509282.090254:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788509282.090257:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509282.090259:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509282.090260:0:7462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788509282.090263:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788509282.090265:0:7462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788509282.090294:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509282.090297:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509282.090298:0:7462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788509282.090301:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1788509282.090884:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d30640f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796691200:0@lo:38: 00000100:00100000:0.0:1788509282.091042:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509282.091123:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796691200 00000100:00100000:0.0:1788509282.091131:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796691200 00000100:00100000:0.0:1788509282.091163:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509282.091169:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3cf28e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875387796691200:12345-0@lo:38: 00010000:00080000:0.0:1788509282.091195:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788509282.091228:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310dd4f5 00000004:00100000:0.0:1788509282.091243:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788509282.091248:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788509282.095141:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796691328:0@lo:400: 00000020:01000000:1.0:1788509282.095148:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788509282.095193:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788509282.095211:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000b79bac04/0xe5156b86310dd4a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509282.095222:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000b79bac04/0xe5156b86310dd4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509282.095231:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcdbbf0f800 from 1 10000000:01000000:1.0:1788509282.095234:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788509282.095261:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509282.095270:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509282.095271:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509282.095284:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509282.095299:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000696c29a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691456:0@lo:101: 00000100:00100000:1.0:1788509282.095339:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509282.095378:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c494b996 going to sleep for 11 seconds 00000100:00100000:2.0:1788509282.095391:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796691328 00000100:00100000:2.0:1788509282.095400:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796691328 00000100:00100000:1.0:1788509282.095402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796691456 00000100:00100000:1.0:1788509282.095408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796691456 00000100:00100000:1.0:1788509282.095455:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788509282.095464:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8adbfa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+12:7450:x1875387796691456:12345-0@lo:101: 00010000:00010000:1.0:1788509282.095486:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509282.095496:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd4fc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509282.095503:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788509282.095515:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbe8418d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796691328:12345-0@lo:400: 00010000:00010000:1.0:1788509282.095526:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509282.095538:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509282.095547:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000623b06ef, rc 0) 00000100:00100000:2.0:1788509282.095572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbe8418d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796691328:12345-0@lo:400: Request processed in 59us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509282.095580:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509282.095589:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8adbfa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:7450:x1875387796691456:12345-0@lo:101: Request processed in 126us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509282.095596:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788509282.095634:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000696c29a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691456:0@lo:101: 00010000:00010000:1.0:1788509282.095646:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509282.095654:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788509282.095844:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b1df88db x1875387796691328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509282.095855:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1df88db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796691328:0@lo:400: 00000100:00100000:1.0:1788509282.096200:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000696c29a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691584:0@lo:256: 00000100:00100000:1.0:1788509282.096234:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509282.096264:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c494b996 going to sleep for 11 seconds 00000100:00100000:2.0:1788509282.096280:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796691584 00000100:00100000:2.0:1788509282.096285:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796691584 00000100:00100000:2.0:1788509282.096347:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788509282.096355:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c97f0947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:7450:x1875387796691584:12345-0@lo:256: 20000000:01000000:2.0:1788509282.096368:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788509282.097466:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788509282.097472:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788509282.103028:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c97f0947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:7450:x1875387796691584:12345-0@lo:256: Request processed in 6668us (6787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509282.103044:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788509282.103239:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000696c29a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691584:0@lo:256: 10000000:01000000:2.0:1788509282.103963:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788509282.103982:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.103992:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509282.103999:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdbbf0f800 from 1 10000000:01000000:2.0:1788509282.104011:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788509282.104044:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.104052:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.104060:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509282.104078:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ada55750 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691712:0@lo:101: 00000100:00100000:2.0:1788509282.104131:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509282.104163:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000771f5c22 going to sleep for 11 seconds 00000100:00100000:2.0:1788509282.104184:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796691712 00000100:00100000:2.0:1788509282.104191:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796691712 00000100:00100000:2.0:1788509282.104239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788509282.104246:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000219e7051 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:7450:x1875387796691712:12345-0@lo:101: 00010000:00010000:2.0:1788509282.104257:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509282.104268:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd50a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.104288:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd50a expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.104297:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd50a expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.104304:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd65a62d, rc 0) 00000100:00100000:2.0:1788509282.104335:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000219e7051 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:7450:x1875387796691712:12345-0@lo:101: Request processed in 90us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509282.104350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788509282.104380:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ada55750 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691712:0@lo:101: 00010000:00010000:2.0:1788509282.104391:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.104399:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509282.104481:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ada55750 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691840:0@lo:501: 00000100:00100000:2.0:1788509282.104507:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509282.104520:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000771f5c22 going to sleep for 11 seconds 00000100:00100000:2.0:1788509282.104532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796691840 00000100:00100000:2.0:1788509282.104536:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796691840 00000100:00100000:2.0:1788509282.104555:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788509282.104559:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006362bc37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:7450:x1875387796691840:12345-0@lo:501: 00000100:00100000:2.0:1788509282.105195:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006362bc37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:7450:x1875387796691840:12345-0@lo:501: Request processed in 634us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509282.105204:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788509282.105240:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ada55750 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691840:0@lo:501: 00000100:00100000:2.0:1788509282.105268:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ada55750 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691968:0@lo:503: 00000100:00100000:2.0:1788509282.105305:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509282.105320:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000771f5c22 going to sleep for 11 seconds 00000100:00100000:2.0:1788509282.105335:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796691968 00000100:00100000:2.0:1788509282.105339:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796691968 00000100:00100000:2.0:1788509282.105359:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788509282.105364:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e359dee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:7450:x1875387796691968:12345-0@lo:503: 00000040:00080000:2.0:1788509282.105399:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788509282.105640:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e359dee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:7450:x1875387796691968:12345-0@lo:503: Request processed in 276us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509282.105648:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788509282.109559:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ada55750 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796691968:0@lo:503: 00000040:00080000:0.0:1788509282.110108:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509282.110187:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788509282.110288:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509282.112193:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788509282.112545:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788509282.112581:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788509282.112601:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.112612:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509282.112677:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788509282.112680:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bcdbbf0f800 10000000:01000000:3.0:1788509282.112682:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bcdbbf0f800 10000000:01000000:3.0:1788509282.112686:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788509282.112691:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcdbbf0f800 from 1 10000000:01000000:3.0:1788509282.112694:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509282.112727:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000006c6f79b9/0xe5156b86310dd518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.112735:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000006c6f79b9/0xe5156b86310dd518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.112767:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000006c6f79b9/0xe5156b86310dd518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509282.112788:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692096:0@lo:101: 00000100:00100000:3.0:1788509282.112863:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.112936:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c39afbd going to sleep for 11 seconds 00000100:00100000:3.0:1788509282.112966:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796692096 00000100:00100000:3.0:1788509282.112972:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796692096 00000100:00100000:3.0:1788509282.113017:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788509282.113025:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d361523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:7450:x1875387796692096:12345-0@lo:101: 00010000:00010000:3.0:1788509282.113037:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509282.113048:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d8596fc8/0xe5156b86310dd51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd518 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.113069:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8596fc8/0xe5156b86310dd51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd518 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.113078:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d8596fc8/0xe5156b86310dd51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd518 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.113099:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d8596fc8, rc 0) 00000100:00100000:3.0:1788509282.113134:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d361523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692096:12345-0@lo:101: Request processed in 110us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.113141:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788509282.113183:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692096:0@lo:101: 00010000:00010000:3.0:1788509282.113195:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000006c6f79b9/0xe5156b86310dd518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.113215:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000006c6f79b9/0xe5156b86310dd518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509282.113313:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692224:0@lo:501: 00000100:00100000:3.0:1788509282.113339:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.113362:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796692224 00000100:00100000:3.0:1788509282.113366:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796692224 00000100:00100000:3.0:1788509282.113386:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788509282.113392:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e1a1f6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692224:12345-0@lo:501: 00000100:00100000:3.0:1788509282.113471:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e1a1f6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692224:12345-0@lo:501: Request processed in 79us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.113478:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788509282.113502:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c39afbd going to sleep for 11 seconds 00000100:00100000:3.0:1788509282.113512:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692224:0@lo:501: 00000100:00100000:3.0:1788509282.113537:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692352:0@lo:503: 00000100:00100000:3.0:1788509282.113571:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.113589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796692352 00000100:00100000:3.0:1788509282.113592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796692352 00000100:00100000:3.0:1788509282.113610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788509282.113615:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a41cecd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692352:12345-0@lo:503: 00000100:00100000:3.0:1788509282.113676:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a41cecd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692352:12345-0@lo:503: Request processed in 60us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.113682:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788509282.113710:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c39afbd going to sleep for 11 seconds 00000100:00100000:3.0:1788509282.113721:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692352:0@lo:503: 00000040:00080000:3.0:1788509282.113995:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788509282.114048:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692480:0@lo:502: 00000100:00100000:3.0:1788509282.114079:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.114100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796692480 00000100:00100000:3.0:1788509282.114104:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796692480 00000100:00100000:3.0:1788509282.114124:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788509282.114129:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4c71b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692480:12345-0@lo:502: 00000100:00100000:3.0:1788509282.114191:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4c71b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692480:12345-0@lo:502: Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.114197:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788509282.114228:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c39afbd going to sleep for 11 seconds 00000100:00100000:3.0:1788509282.114239:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692480:0@lo:502: 00000040:00080000:3.0:1788509282.114380:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788509282.114402:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788509282.114415:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788509282.114426:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788509282.114437:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788509282.114449:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788509282.114460:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788509282.114473:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788509282.114484:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788509282.114496:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788509282.114507:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788509282.114520:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788509282.114531:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788509282.114543:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788509282.114555:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788509282.114566:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788509282.114577:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788509282.114599:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788509282.114612:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788509282.114624:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788509282.114636:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788509282.114647:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788509282.114657:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788509282.114668:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788509282.114680:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788509282.114692:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788509282.114704:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788509282.114715:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788509282.114734:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692608:0@lo:502: 00000100:00100000:3.0:1788509282.114767:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.114789:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796692608 00000100:00100000:3.0:1788509282.114793:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796692608 00000100:00100000:3.0:1788509282.114824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788509282.114830:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000816c397a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692608:12345-0@lo:502: 00000100:00100000:3.0:1788509282.114885:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000816c397a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692608:12345-0@lo:502: Request processed in 55us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.114892:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788509282.114959:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c39afbd going to sleep for 11 seconds 00000100:00100000:3.0:1788509282.114972:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692608:0@lo:502: 00000040:00080000:3.0:1788509282.115002:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788509282.115009:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788509282.115249:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788509282.115263:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000108d24fd) 00000020:00000080:3.0:1788509282.115281:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788509282.115353:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cca53e81 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788509282.115357:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000cca53e81 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788509282.115365:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000cca53e81 3 00010000:00080000:3.0:1788509282.115393:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003a150e3f@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.112@tcp at head 00000100:00080000:2.0:1788509282.117608:0:6525:0:(import.c:65:import_set_state_nolock()) 000000009536872f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509282.117985:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3cf28e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875387796691200:12345-0@lo:38: Request processed in 26811us (26940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509282.118002:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509282.122506:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509282.122525:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788509282.122533:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788509282.122538:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788509282.122541:0:3643:0:(import.c:65:import_set_state_nolock()) 000000002e8fdb53 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788509282.122766:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f581bbee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796692736:0@lo:41: 00000100:00100000:2.0:1788509282.123118:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509282.123187:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d30640f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796691200:0@lo:38: 00010000:00010000:3.0:1788509282.124330:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788509282.124995:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788509282.125042:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788509282.125056:0:7468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe5156b86310dd52d 00000100:00080000:3.0:1788509282.125066:0:7468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788509282.125071:0:7468:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003a150e3f using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509282.127024:0:7468:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000031567dca x1875387796692864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788509282.127060:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788509282.128289:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875387796692864:0@lo:38: 00000100:00100000:1.0:1788509282.128365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509282.129203:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796692864 00000100:00100000:1.0:1788509282.129213:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796692864 00000100:00100000:1.0:1788509282.129267:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509282.129273:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001573610b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796692864:12345-0@lo:38: 00010000:00080000:1.0:1788509282.129298:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1788509282.129333:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe5156b86310dd534 00000004:00100000:1.0:1788509282.129348:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788509282.129376:0:6521:0:(import.c:65:import_set_state_nolock()) 00000000cd2d7598 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509282.129715:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001573610b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875387796692864:12345-0@lo:38: Request processed in 440us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509282.129724:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788509282.129928:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000031567dca x1875387796692864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509282.129940:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788509282.129948:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788509282.129954:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788509282.129959:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788509282.129962:0:3643:0:(import.c:65:import_set_state_nolock()) 000000003a150e3f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788509282.129967:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031567dca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875387796692864:0@lo:38: 00000100:00100000:3.0:1788509282.130978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796692736 00000100:00100000:3.0:1788509282.130987:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796692736 00000100:00100000:3.0:1788509282.131037:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509282.131045:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8f5457e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796692736:12345-0@lo:41: 00000004:00000024:3.0:1788509282.131075:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788509282.131215:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8f5457e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796692736:12345-0@lo:41: Request processed in 171us (8097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.131223:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788509282.136331:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509282.137070:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f581bbee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796692736:0@lo:41: 00000040:00080000:3.0:1788509282.137332:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788509282.137606:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788509282.137644:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788509282.137663:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000006c6f79b9/0xe5156b86310dd518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509282.137673:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000006c6f79b9/0xe5156b86310dd518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788509282.137723:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788509282.137726:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788509282.137731:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509282.137733:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509282.137734:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509282.137735:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509282.137736:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509282.137738:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788509282.137749:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788509282.137750:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509282.137751:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788509282.137755:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788509282.137757:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788509282.137758:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788509282.137759:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509282.137760:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509282.137761:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509282.137762:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509282.137762:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509282.137763:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788509282.137764:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788509282.137765:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509282.137766:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788509282.137789:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788509282.137813:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692992:0@lo:253: 00000100:00100000:1.0:1788509282.137872:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509282.137947:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a311f2fc going to sleep for 11 seconds 00000100:00100000:3.0:1788509282.138294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796692992 00000100:00100000:3.0:1788509282.138303:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796692992 00000100:00100000:3.0:1788509282.138344:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788509282.138352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004160dcac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692992:12345-0@lo:253: 20000000:01000000:3.0:1788509282.138378:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788509282.138390:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:2.0:1788509282.140218:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:3.0:1788509282.144355:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788509282.144464:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788509282.144492:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788509282.145367:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004160dcac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7450:x1875387796692992:12345-0@lo:253: Request processed in 7010us (7490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509282.145382:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788509282.145562:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7450:1875387796692992:0@lo:253: 10000000:01000000:1.0:1788509282.145577:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788509282.145580:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788509282.145582:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788509282.145583:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509282.145584:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509282.145586:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509282.145587:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509282.145588:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509282.145590:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788509282.145591:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788509282.145592:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509282.145593:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788509282.145631:0:7450:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788509282.150405:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788509282.150437:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788509282.150465:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.150491:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd454 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.150499:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.150506:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.150564:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.150585:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 14 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509282.150604:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016ef5104 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796693120:0@lo:104: 00000100:00100000:3.0:1788509282.150694:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788509282.150771:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd454 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.150783:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd454 expref: 14 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509282.150784:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796693120 00000100:00100000:3.0:1788509282.150800:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001805694c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796693248:0@lo:104: 00000100:00100000:0.0:1788509282.150811:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796693120 00000100:00100000:3.0:1788509282.150831:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509282.150861:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796693248 00000100:00100000:3.0:1788509282.150864:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3d554fb going to sleep for 11 seconds 00000100:00100000:0.0:1788509282.150866:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796693248 00000100:00100000:0.0:1788509282.150890:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509282.150936:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788509282.150940:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095b75d82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6536:x1875387796693120:12345-0@lo:104: 00000100:00100000:3.0:1788509282.150958:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788509282.150963:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509282.151216:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788509282.151227:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e95a8e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6536:x1875387796693248:12345-0@lo:104: 00010000:00010000:3.0:1788509282.151240:0:7471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.151376:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509282.151385:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095b75d82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6536:x1875387796693120:12345-0@lo:104: Request processed in 487us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509282.151392:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788509282.151430:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509282.151436:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.151444:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee16fef4 already unused, calling callback (0000000098267291) 10000000:00010000:0.0:1788509282.151447:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.151456:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509282.151471:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509282.151476:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509282.151514:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.151522:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509282.151538:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.151545:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd4fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd503 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.151559:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509282.151561:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509282.151562:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509282.151583:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fbd770e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796693376:0@lo:103: 00010000:00010000:3.0:1788509282.151849:0:7471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509282.151857:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e95a8e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6536:x1875387796693248:12345-0@lo:104: Request processed in 632us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.151866:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509282.151987:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509282.152064:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509282.152068:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.152076:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c991df41 already unused, calling callback (0000000098267291) 10000000:00010000:0.0:1788509282.152078:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.152162:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509282.152166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796693376 00000100:00100000:3.0:1788509282.152178:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796693376 10000000:00010000:0.0:1788509282.152192:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509282.152199:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788509282.152215:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 15 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.152226:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.152236:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509282.152362:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.152369:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000c991df41/0xe5156b86310dd454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd45b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509282.152385:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509282.152387:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509282.152389:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509282.152401:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796693504:0@lo:103: 00000100:00100000:0.0:1788509282.152504:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509282.152544:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796693504 00000100:00100000:0.0:1788509282.152550:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796693504 00010000:00010000:0.0:1788509282.152571:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd454 expref: 16 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509282.152841:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509282.152857:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c7027a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3645:x1875387796693376:12345-0@lo:103: 00010000:00010000:3.0:1788509282.152874:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509282.152881:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 16 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.152895:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 16 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509282.152964:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509282.153030:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c7027a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3645:x1875387796693376:12345-0@lo:103: Request processed in 179us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509282.157728:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788509282.158331:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788509282.158538:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000623b06ef/0xe5156b86310dd503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd4fc expref: 16 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509282.158560:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016ef5104 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796693120:0@lo:104: 00000100:00100000:2.0:1788509282.158575:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001805694c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796693248:0@lo:104: 00010000:00010000:2.0:1788509282.158603:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788509282.159770:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00000100:00100000:0.0:1788509282.161060:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fbd770e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796693376:0@lo:103: 00080000:10000000:1.0:1788509282.164041:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:3.0:1788509282.165858:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788509282.166007:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788509282.166099:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d432ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:3646:x1875387796693504:12345-0@lo:103: 00010000:00010000:2.0:1788509282.166121:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509282.166130:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd454 expref: 14 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.166162:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd454 expref: 14 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.166180:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c9b02fe/0xe5156b86310dd45b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd454 expref: 14 pid: 6515 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.166197:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.166206:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788509282.166222:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015788200s 00010000:00010000:2.0:1788509282.166238:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.166246:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.166252:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.167057:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.167064:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000255656b6 already unused, calling callback (00000000b73d62c5) 00010000:00010000:2.0:1788509282.167067:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.167076:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.167107:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.167120:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509282.167170:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.167178:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509282.167183:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000255656b6/0xe5156b86310dd53b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509282.171376:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d432ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:3646:x1875387796693504:12345-0@lo:103: Request processed in 5283us (18865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.171400:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00080000:10000000:1.0:1788509282.172579:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788509282.172795:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:0.0:1788509282.173040:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796693504:0@lo:103: 00080000:10000000:1.0:1788509282.174685:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788509282.176606:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788509282.183516:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788509282.183786:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788509282.185424:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788509282.185676:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788509282.185891:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788509282.186988:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1788509282.190699:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1788509282.191629:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1788509282.191698:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875387796693632:0@lo:700: 00000100:00100000:1.0:1788509282.191774:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.191958:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796693632 00000100:00100000:3.0:1788509282.191967:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796693632 00000100:00100000:3.0:1788509282.192009:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509282.192018:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084d778d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1875387796693632:12345-0@lo:700: 00000040:01000000:0.0:1788509282.192434:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788509282.192867:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2627523 going to sleep for 11 seconds 00000100:00100000:3.0:1788509282.193440:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796693760:0@lo:1000: 00000100:00100000:3.0:1788509282.193495:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.193525:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 000000005eedbaa8 going to sleep for 11 seconds 00000100:00100000:1.0:1788509282.193649:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796693760 00000100:00100000:1.0:1788509282.193656:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796693760 00000100:00100000:1.0:1788509282.193696:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509282.193703:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097efa0b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796693760:12345-0@lo:1000: 00000100:00100000:1.0:1788509282.193796:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097efa0b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796693760:12345-0@lo:1000: Request processed in 93us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.194039:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796693760:0@lo:1000: 00000040:01000000:3.0:1788509282.194087:0:7477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788509282.194113:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796693888:0@lo:700: 00000100:00100000:3.0:1788509282.194141:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.194155:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007573828 going to sleep for 11 seconds 00000100:00100000:1.0:1788509282.194386:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509282.194534:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796693888 00000100:00100000:0.0:1788509282.194539:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796693888 00000100:00100000:0.0:1788509282.194574:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509282.194581:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062253592 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796693888:12345-0@lo:700: 00000100:00100000:0.0:1788509282.194644:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062253592 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796693888:12345-0@lo:700: Request processed in 63us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509282.194651:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788509282.195680:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1788509282.195956:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796693888:0@lo:700: 00000100:00100000:3.0:1788509282.196011:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1875387796694016:0@lo:900: 00000100:00100000:3.0:1788509282.196064:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788509282.196364:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788509282.196526:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796694016 00000100:00100000:3.0:1788509282.196532:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796694016 00000100:00100000:3.0:1788509282.196575:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509282.196581:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e98ee81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1875387796694016:12345-0@lo:900: 00000100:00100000:3.0:1788509282.196694:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e98ee81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1875387796694016:12345-0@lo:900: Request processed in 113us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.196702:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509282.196726:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007573828 going to sleep for 11 seconds 00010000:00080000:3.0:1788509282.197192:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d604df9a x1875387796694016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788509298 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509282.197214:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1875387796694016:0@lo:900: 00000100:00100000:3.0:1788509282.197537:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796694144:0@lo:1000: 00000100:00100000:3.0:1788509282.197577:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.197642:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009607cbc going to sleep for 11 seconds 00000004:00000080:0.0:1788509282.197938:0:7450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788509282.197950:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788509282.198296:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788509282.199749:0:7475:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788509282.199754:0:7475:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788509282.202535:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788509282.204193:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788509282.204259:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788509282.204487:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788509282.204708:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788509282.205307:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788509282.205482:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788509282.205620:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788509282.205740:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788509282.205874:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788509282.206111:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788509282.206249:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788509282.206381:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788509282.206532:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788509282.206680:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788509282.206802:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:1.0:1788509282.207670:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796694144 00000100:00100000:1.0:1788509282.207685:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796694144 40000000:02000000:2.0:1788509282.207988:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1788509282.208223:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788509282.208589:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000100:00100000:3.0:1788509282.209058:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509282.209068:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ca43e7a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796694144:12345-0@lo:1000: 00000100:00100000:3.0:1788509282.209331:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ca43e7a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796694144:12345-0@lo:1000: Request processed in 264us (11753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509282.209338:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509282.209382:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796694144:0@lo:1000: 00000004:00080000:3.0:1788509282.209514:0:7477:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000007573828 with version 0 00000020:00100000:3.0:1788509282.209535:0:7477:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788509282.209540:0:7477:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d604df9a x1875387796694400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788509282.209555:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796694400:0@lo:1000: 00000100:00100000:3.0:1788509282.209584:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509282.209607:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796694400 00000100:00100000:3.0:1788509282.209611:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796694400 00000100:00100000:3.0:1788509282.209714:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509282.209718:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf3ef4a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796694400:12345-0@lo:1000: 00000100:00100000:3.0:1788509282.210182:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047c74f51 going to sleep for 11 seconds 00100000:10000000:0.0:1788509282.210497:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788509282.210724:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788509282.211240:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788509282.211817:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788509282.212539:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788509282.212843:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788509282.213354:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788509282.213689:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788509282.214025:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:2.0:1788509282.221389:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084d778d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1875387796693632:12345-0@lo:700: Request processed in 29366us (29608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509282.221421:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788509282.221783:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002111fafe x1875387796693632/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788509298 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509282.221799:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875387796693632:0@lo:700: 40000000:02000000:1.0:1788509282.221811:0:7476:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1788509282.228598:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000001:00080000:3.0:1788509282.230249:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1788509282.230362:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf3ef4a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796694400:12345-0@lo:1000: Request processed in 20640us (20774us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788509282.230396:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:3.0:1788509282.230445:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788509282.230603:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000004:00080000:2.0:1788509282.231372:0:7477:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788509282.231379:0:7477:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788509282.231393:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796694400:0@lo:1000: 00000100:00100000:2.0:1788509282.231489:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f145314 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796694528:0@lo:1000: 00000100:00100000:2.0:1788509282.231536:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509282.231579:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 00000000771f5c22 going to sleep for 11 seconds 00000100:00100000:0.0:1788509282.231734:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796694528 00000100:00100000:0.0:1788509282.231750:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796694528 00000100:00100000:0.0:1788509282.231801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509282.231807:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000578fa134 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796694528:12345-0@lo:1000: 00000100:00100000:0.0:1788509282.231873:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000578fa134 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1875387796694528:12345-0@lo:1000: Request processed in 66us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509282.231879:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788509282.233225:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f145314 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875387796694528:0@lo:1000: 00000040:00080000:2.0:1788509282.233254:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788509282.233295:0:7477:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000474c017c with version 1 00100000:10000000:3.0:1788509282.234390:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000004:00080000:0.0:1788509282.235862:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003f7ce513 version 1 rpc_version 1 00000020:00100000:0.0:1788509282.235930:0:7465:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788509282.235939:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d6b9ed64 x1875387796694784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509282.235974:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875387796694784:0@lo:1000: 00000100:00100000:0.0:1788509282.236040:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509282.236101:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796694784 00000100:00100000:0.0:1788509282.236107:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796694784 00000100:00100000:0.0:1788509282.236173:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509282.236181:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fbd770e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875387796694784:12345-0@lo:1000: 00000100:00100000:0.0:1788509282.236326:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000003010f104 going to sleep for 11 seconds 00100000:10000000:3.0:1788509282.237197:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788509282.238106:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788509282.238275:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788509282.238406:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788509282.238567:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000040:00080000:2.0:1788509282.239968:0:7477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788509282.240048:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1788509282.242002:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788509282.242527:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788509282.246875:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788509282.248566:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fbd770e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875387796694784:12345-0@lo:1000: Request processed in 12375us (12515us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788509282.248608:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788509282.249533:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788509282.249543:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788509282.249566:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875387796694784:0@lo:1000: 00000001:00080000:3.0:1788509282.252882:0:7450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788509282.253112:0:7450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb93b41a4b988 00100000:10000000:3.0:1788509282.253122:0:7450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788509282.254592:0:7450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788509282.254642:0:7450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788509282.254672:0:7450:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788509282.254702:0:7450:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788509282.255645:0:7450:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788509282.255868:0:7450:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1788509282.294251:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509282.313826:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788509282.313949:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788509282.313954:0:7476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788509283.158624:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509284.182187:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509285.210465:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509286.230034:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788509287.126051:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788509287.126059:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcdbbf0f800 from 4 10000000:01000000:3.0:1788509287.126064:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788509287.126113:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000a476b0bb/0xe5156b86310dd542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509287.126126:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000a476b0bb/0xe5156b86310dd542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509287.126135:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000a476b0bb/0xe5156b86310dd542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509287.126157:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a5fa4ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796694912:0@lo:101: 00000100:00100000:3.0:1788509287.126310:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509287.126420:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000007009ccfe going to sleep for 11 seconds 00000100:00100000:0.0:1788509287.126516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796694912 00000100:00100000:0.0:1788509287.126524:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796694912 00000100:00100000:0.0:1788509287.126576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788509287.126584:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005363b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:6517:x1875387796694912:12345-0@lo:101: 00010000:00010000:0.0:1788509287.126597:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509287.126610:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006628c4df/0xe5156b86310dd549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd542 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.126632:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006628c4df/0xe5156b86310dd549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd542 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.126643:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006628c4df/0xe5156b86310dd549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd542 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.126652:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006628c4df, rc 0) 00000100:00100000:0.0:1788509287.126694:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005363b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:6517:x1875387796694912:12345-0@lo:101: Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509287.126708:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788509287.126752:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a5fa4ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796694912:0@lo:101: 00010000:00010000:0.0:1788509287.126764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000a476b0bb/0xe5156b86310dd542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.126772:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000a476b0bb/0xe5156b86310dd542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509287.126815:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695040:0@lo:256: 00000100:00100000:0.0:1788509287.126843:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509287.126856:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e296329 going to sleep for 11 seconds 00000100:00100000:0.0:1788509287.126882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796695040 00000100:00100000:0.0:1788509287.126886:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796695040 00000100:00100000:0.0:1788509287.126931:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788509287.126937:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000330b390b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:6517:x1875387796695040:12345-0@lo:256: 20000000:01000000:0.0:1788509287.126949:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788509287.126962:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788509287.126965:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788509287.127033:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000330b390b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:6517:x1875387796695040:12345-0@lo:256: Request processed in 96us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509287.127040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788509287.127068:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695040:0@lo:256: 10000000:01000000:0.0:1788509287.127451:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788509287.127458:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000a476b0bb/0xe5156b86310dd542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.127467:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000a476b0bb/0xe5156b86310dd542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509287.127481:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788509287.127482:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd82e88800 from 21 10000000:01000000:0.0:1788509287.127485:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788509287.127502:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000be94638d/0xe5156b86310dd550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.127509:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000be94638d/0xe5156b86310dd550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.127516:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000be94638d/0xe5156b86310dd550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509287.127527:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695168:0@lo:101: 00000100:00100000:0.0:1788509287.127554:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509287.127576:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e296329 going to sleep for 11 seconds 00000100:00100000:0.0:1788509287.127588:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796695168 00000100:00100000:0.0:1788509287.127592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796695168 00000100:00100000:0.0:1788509287.127614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788509287.127620:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cd02e69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:6517:x1875387796695168:12345-0@lo:101: 00010000:00010000:0.0:1788509287.127628:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509287.127636:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000667bfb87/0xe5156b86310dd557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd550 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.127651:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000667bfb87/0xe5156b86310dd557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd550 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.127658:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000667bfb87/0xe5156b86310dd557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd550 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.127676:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000667bfb87, rc 0) 00000100:00100000:0.0:1788509287.127706:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cd02e69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796695168:12345-0@lo:101: Request processed in 87us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509287.127713:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788509287.127743:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695168:0@lo:101: 00010000:00010000:0.0:1788509287.127753:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000be94638d/0xe5156b86310dd550 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.127760:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000be94638d/0xe5156b86310dd550 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509287.127818:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695296:0@lo:501: 00000100:00100000:0.0:1788509287.127842:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509287.127866:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e296329 going to sleep for 11 seconds 00000100:00100000:3.0:1788509287.128264:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796695296 00000100:00100000:3.0:1788509287.128270:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796695296 00000100:00100000:3.0:1788509287.128295:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788509287.128300:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021375d43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796695296:12345-0@lo:501: 00000100:00100000:3.0:1788509287.128488:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021375d43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796695296:12345-0@lo:501: Request processed in 187us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509287.128496:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788509287.129294:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695296:0@lo:501: 00000100:00100000:0.0:1788509287.129334:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695424:0@lo:503: 00000100:00100000:0.0:1788509287.129501:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509287.129529:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e296329 going to sleep for 11 seconds 00000100:00100000:0.0:1788509287.129545:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796695424 00000100:00100000:0.0:1788509287.129550:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796695424 00000100:00100000:0.0:1788509287.129624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788509287.129631:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000835d2d39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796695424:12345-0@lo:503: 00000100:00100000:0.0:1788509287.129726:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000835d2d39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796695424:12345-0@lo:503: Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509287.129733:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788509287.140064:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695424:0@lo:503: 00000100:00100000:3.0:1788509287.142713:0:7709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdc9eb92 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7709:1875387796695552:0@lo:502: 00000100:00100000:3.0:1788509287.142797:0:7709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509287.142842:0:7709:0:(client.c:2716:ptlrpc_set_wait()) set 000000006aed3b48 going to sleep for 11 seconds 00000100:00100000:0.0:1788509287.142931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796695552 00000100:00100000:0.0:1788509287.142939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796695552 00000100:00100000:0.0:1788509287.142979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788509287.142988:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbff260b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7709:x1875387796695552:12345-0@lo:502: 00000100:00100000:0.0:1788509287.143479:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbff260b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7709:x1875387796695552:12345-0@lo:502: Request processed in 491us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509287.143488:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788509287.143581:0:7709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdc9eb92 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7709:1875387796695552:0@lo:502: 00000100:00100000:3.0:1788509287.143628:0:7709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdc9eb92 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7709:1875387796695680:0@lo:502: 00000100:00100000:3.0:1788509287.143663:0:7709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509287.143689:0:7709:0:(client.c:2716:ptlrpc_set_wait()) set 000000006aed3b48 going to sleep for 11 seconds 00000100:00100000:0.0:1788509287.143735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796695680 00000100:00100000:0.0:1788509287.143740:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796695680 00000100:00100000:0.0:1788509287.143806:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788509287.143813:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7fa642f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7709:x1875387796695680:12345-0@lo:502: 00000100:00100000:0.0:1788509287.143893:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7fa642f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:7709:x1875387796695680:12345-0@lo:502: Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509287.143929:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788509287.148963:0:7709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdc9eb92 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7709:1875387796695680:0@lo:502: 00000040:00080000:2.0:1788509287.149018:0:7709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788509287.149338:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788509287.149362:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788509287.149372:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000be94638d/0xe5156b86310dd550 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.149383:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000be94638d/0xe5156b86310dd550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509287.149393:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788509287.149395:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd82e88800 from 4 10000000:01000000:1.0:1788509287.149398:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788509287.149436:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000623b06ef/0xe5156b86310dd55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.149443:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000623b06ef/0xe5156b86310dd55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.149466:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000623b06ef/0xe5156b86310dd55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509287.149484:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695808:0@lo:101: 00000100:00100000:1.0:1788509287.149545:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.153341:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2627523 going to sleep for 11 seconds 00000100:00100000:3.0:1788509287.155362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796695808 00000100:00100000:3.0:1788509287.155378:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796695808 00000100:00100000:3.0:1788509287.155438:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788509287.155447:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3908ec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796695808:12345-0@lo:101: 00010000:00010000:3.0:1788509287.155463:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509287.155480:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b491d909/0xe5156b86310dd565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd55e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509287.155511:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b491d909/0xe5156b86310dd565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd55e expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509287.155541:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b491d909/0xe5156b86310dd565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd55e expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509287.155550:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b491d909, rc 0) 00000100:00100000:3.0:1788509287.155630:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3908ec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796695808:12345-0@lo:101: Request processed in 184us (6085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509287.155637:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788509287.155722:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695808:0@lo:101: 00010000:00010000:1.0:1788509287.155740:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000623b06ef/0xe5156b86310dd55e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.155748:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000623b06ef/0xe5156b86310dd55e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509287.155811:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695936:0@lo:256: 00000100:00100000:1.0:1788509287.155848:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.155917:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2627523 going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.155930:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796695936 00000100:00100000:1.0:1788509287.155934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796695936 00000100:00100000:1.0:1788509287.155952:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788509287.155957:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8cec1d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796695936:12345-0@lo:256: 20000000:01000000:1.0:1788509287.155971:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788509287.155994:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788509287.155997:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788509287.156086:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8cec1d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796695936:12345-0@lo:256: Request processed in 128us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.156093:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788509287.156122:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796695936:0@lo:256: 10000000:01000000:1.0:1788509287.156292:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788509287.156299:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000623b06ef/0xe5156b86310dd55e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.156307:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000623b06ef/0xe5156b86310dd55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509287.156315:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788509287.156317:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788509287.156320:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788509287.156337:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000008c9b02fe/0xe5156b86310dd56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.156343:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000008c9b02fe/0xe5156b86310dd56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.156350:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000008c9b02fe/0xe5156b86310dd56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509287.156361:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796696064:0@lo:101: 00000100:00100000:1.0:1788509287.156385:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.156396:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db3e77ca going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.156411:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796696064 00000100:00100000:1.0:1788509287.156415:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796696064 00000100:00100000:1.0:1788509287.156430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788509287.156435:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b38ae69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796696064:12345-0@lo:101: 00010000:00010000:1.0:1788509287.156442:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509287.156449:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a74e580d/0xe5156b86310dd573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd56c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.156469:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a74e580d/0xe5156b86310dd573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd56c expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.156476:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a74e580d/0xe5156b86310dd573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd56c expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.156481:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a74e580d, rc 0) 00000100:00100000:1.0:1788509287.156510:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b38ae69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796696064:12345-0@lo:101: Request processed in 75us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.156516:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788509287.156537:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796696064:0@lo:101: 00010000:00010000:1.0:1788509287.156546:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000008c9b02fe/0xe5156b86310dd56c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.156553:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000008c9b02fe/0xe5156b86310dd56c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509287.156698:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796696192:0@lo:501: 00000100:00100000:1.0:1788509287.156722:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.156731:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db3e77ca going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.156748:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796696192 00000100:00100000:1.0:1788509287.156752:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796696192 00000100:00100000:1.0:1788509287.156767:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788509287.156771:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3291b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796696192:12345-0@lo:501: 00000100:00100000:1.0:1788509287.156889:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3291b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796696192:12345-0@lo:501: Request processed in 116us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.156896:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788509287.156946:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796696192:0@lo:501: 00000100:00100000:1.0:1788509287.156971:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796696320:0@lo:503: 00000100:00100000:1.0:1788509287.157107:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.157117:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db3e77ca going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.157133:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796696320 00000100:00100000:1.0:1788509287.157137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796696320 00000100:00100000:1.0:1788509287.157223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788509287.157230:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e74f4cca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796696320:12345-0@lo:503: 00000100:00100000:1.0:1788509287.157301:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e74f4cca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796696320:12345-0@lo:503: Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.157307:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788509287.157334:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002111fafe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796696320:0@lo:503: 00000100:00100000:3.0:1788509287.168476:0:7711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000657a7f77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7711:1875387796696448:0@lo:502: 00000100:00100000:3.0:1788509287.168558:0:7711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509287.168599:0:7711:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c2d5240d going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.169330:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796696448 00000100:00100000:1.0:1788509287.169338:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796696448 00000100:00100000:1.0:1788509287.169389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788509287.169398:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000200a8b93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:7711:x1875387796696448:12345-0@lo:502: 00000100:00100000:1.0:1788509287.169540:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000200a8b93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:7711:x1875387796696448:12345-0@lo:502: Request processed in 143us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.169548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788509287.169619:0:7711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000657a7f77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7711:1875387796696448:0@lo:502: 00000020:01000000:1.0:1788509287.169648:0:7711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509287.169659:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509287.169661:0:7711:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788509287.169667:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788509287.169670:0:7711:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:1.0:1788509287.169690:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509287.169708:0:7711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000006797b495) 00000020:00000080:1.0:1788509287.169727:0:7711:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788509287.169733:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788509287.169807:0:7711:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788509287.169812:0:7711:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788509287.169818:0:7711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dd581 00010000:00080000:1.0:1788509287.169844:0:7711:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c806b3ec@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509287.171427:0:7711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1788509287.185783:0:7711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788509287.185799:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788509287.185838:0:7711:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788509287.185859:0:7711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dd588 00000100:00080000:0.0:1788509287.185880:0:7711:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788509287.185887:0:7711:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000c806b3ec using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509287.186625:0:7711:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000657a7f77 x1875387796696576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788509287.186850:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000657a7f77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796696576:0@lo:38: 00000100:00100000:1.0:1788509287.186957:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788509287.187325:0:7711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788509287.187367:0:7711:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788509287.187489:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdc9eb92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796696704:0@lo:400: 00000100:00100000:3.0:1788509287.187525:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509287.187560:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a5fa4ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796696832:0@lo:400: 00000100:00100000:3.0:1788509287.187584:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788509287.188465:0:7711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509287.188471:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509287.188473:0:7711:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788509287.188476:0:7711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509287.188480:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509287.188481:0:7711:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788509287.188484:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788509287.188485:0:7711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788509287.188513:0:7711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039ec9797 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7711:1875387796697088:0@lo:502: 00000100:00100000:1.0:1788509287.188560:0:7711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.188584:0:7711:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010f5dbfd going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.188600:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796697088 00000100:00100000:1.0:1788509287.188606:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796697088 00000100:00100000:1.0:1788509287.188648:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788509287.188656:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf813657 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:7711:x1875387796697088:12345-0@lo:502: 00000100:00100000:1.0:1788509287.188767:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf813657 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:7711:x1875387796697088:12345-0@lo:502: Request processed in 111us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.188775:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788509287.188825:0:7711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039ec9797 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7711:1875387796697088:0@lo:502: 00000020:01000000:1.0:1788509287.188854:0:7711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509287.188858:0:7711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509287.188859:0:7711:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788509287.188862:0:7711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788509287.188981:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788509287.189003:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788509287.189011:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000008c9b02fe/0xe5156b86310dd56c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.189019:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000008c9b02fe/0xe5156b86310dd56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509287.189251:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788509287.189254:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bcd9e5d99c0 from 1 10000000:01000000:1.0:1788509287.189258:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788509287.189283:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.189291:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509287.189299:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509287.189310:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039ec9797 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796697216:0@lo:101: 00000100:00100000:1.0:1788509287.189337:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.189360:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010f5dbfd going to sleep for 11 seconds 00000100:00100000:2.0:1788509287.189378:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796697216 00000100:00100000:2.0:1788509287.189383:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796697216 00000100:00100000:2.0:1788509287.189415:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788509287.189421:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f74c5273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796697216:12345-0@lo:101: 00010000:00010000:2.0:1788509287.189430:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788509287.189436:0:7718:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000068d7f78 x1875387796697344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788509287.189440:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009167a43b/0xe5156b86310dd596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd58f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509287.189444:0:7718:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b793b79 going to sleep for 0 seconds 00010000:00010000:2.0:1788509287.189460:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009167a43b/0xe5156b86310dd596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd58f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509287.189470:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009167a43b/0xe5156b86310dd596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd58f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509287.189478:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009167a43b, rc 0) 00000100:00100000:2.0:1788509287.189506:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f74c5273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796697216:12345-0@lo:101: Request processed in 86us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509287.189513:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788509287.189547:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509287.189554:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796696960:0@lo:400: 00000100:00100000:3.0:1788509287.189577:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509287.189606:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796696704 00000100:00100000:3.0:1788509287.189610:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796696704 00000100:00100000:3.0:1788509287.189636:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796696960 00000100:00100000:3.0:1788509287.189639:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796696960 00000100:00100000:3.0:1788509287.189653:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509287.189665:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001805694c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796696704:12345-0@lo:400: 00000100:00100000:3.0:1788509287.189702:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001805694c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796696704:12345-0@lo:400: Request processed in 38us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509287.189708:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509287.189721:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509287.189725:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031567dca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796696960:12345-0@lo:400: 00000100:00100000:3.0:1788509287.189750:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031567dca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796696960:12345-0@lo:400: Request processed in 25us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509287.189755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788509287.189793:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bdc9eb92 x1875387796696704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509287.189804:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdc9eb92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796696704:0@lo:400: 00010000:00080000:3.0:1788509287.189820:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d604df9a x1875387796696960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509287.189827:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796696960:0@lo:400: 00000100:00100000:0.0:1788509287.195341:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796696576 00000100:00100000:0.0:1788509287.195355:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796696576 00000100:00100000:0.0:1788509287.195389:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796696832 00000100:00100000:0.0:1788509287.195391:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796696832 00000100:00100000:0.0:1788509287.195416:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509287.195422:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002111fafe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875387796696576:12345-0@lo:38: 00010000:00080000:0.0:1788509287.195449:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1788509287.195491:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dd59d 00000004:00100000:0.0:1788509287.195505:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788509287.195509:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788509287.196113:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039ec9797 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796697216:0@lo:101: 00010000:00010000:0.0:1788509287.196136:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd58f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509287.196158:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd58f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509287.196231:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796697472:0@lo:501: 00000100:00100000:0.0:1788509287.196287:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.196321:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796697472 00000100:00100000:0.0:1788509287.196321:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec79a201 going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.196326:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796697472 00000100:00100000:1.0:1788509287.196368:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788509287.196374:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000389fa22e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796697472:12345-0@lo:501: 00000100:00100000:1.0:1788509287.196471:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000389fa22e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796697472:12345-0@lo:501: Request processed in 97us (184us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788509287.196478:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788509287.196543:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6b9ed64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796697472:0@lo:501: 10000000:01000000:3.0:1788509287.196569:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788509287.196574:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd58f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509287.196581:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000ee16fef4/0xe5156b86310dd58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788509287.224806:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000476880e7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509287.224964:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788509287.224974:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788509287.224981:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788509287.225285:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788509287.225293:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000c806b3ec lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788509287.225309:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002b793b79): req@00000000068d7f78 x1875387796697344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509287.225326:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000657a7f77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796696576:0@lo:38: 00000100:00100000:3.0:1788509287.226067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796697600:0@lo:41: 00000100:00100000:1.0:1788509287.227740:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002111fafe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875387796696576:12345-0@lo:38: Request processed in 32311us (40778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.227753:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788509287.227790:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509287.227801:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016ef5104 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796696832:12345-0@lo:400: 00000100:00100000:1.0:1788509287.227923:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016ef5104 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796696832:12345-0@lo:400: Request processed in 127us (40338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.227931:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509287.227980:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a5fa4ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796696832:0@lo:400: 00000100:00100000:2.0:1788509287.231416:0:7718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509287.231470:0:7718:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b793b79 going to sleep for 11 seconds 00000100:00100000:0.0:1788509287.232132:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796697344 00000100:00100000:0.0:1788509287.232143:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796697344 00000100:00100000:0.0:1788509287.232201:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509287.232210:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f145314 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7718:x1875387796697344:12345-0@lo:1000: 00000100:00100000:0.0:1788509287.232297:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f145314 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7718:x1875387796697344:12345-0@lo:1000: Request processed in 89us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509287.232304:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788509287.232313:0:7718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000068d7f78 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796697344:0@lo:1000: 00000040:01000000:2.0:1788509287.232347:0:7718:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788509287.232384:0:7718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cb7c83c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796697728:0@lo:1000: 00000100:00100000:2.0:1788509287.232417:0:7718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509287.232450:0:7718:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000ee23c5 going to sleep for 11 seconds 00000100:00100000:3.0:1788509287.234190:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509287.234263:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796697728 00000100:00100000:3.0:1788509287.234272:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796697728 00000100:00100000:3.0:1788509287.234302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796697600 00000100:00100000:3.0:1788509287.234304:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796697600 00000100:00100000:3.0:1788509287.234316:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788509287.234322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006974b793 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7718:x1875387796697728:12345-0@lo:1000: 00000100:00100000:3.0:1788509287.234465:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006974b793 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7718:x1875387796697728:12345-0@lo:1000: Request processed in 143us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509287.234473:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788509287.234490:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509287.234495:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdc9eb92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796697600:12345-0@lo:41: 00000004:00000024:3.0:1788509287.234516:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788509287.234549:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdc9eb92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796697600:12345-0@lo:41: Request processed in 54us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509287.234555:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509287.234591:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d604df9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796697600:0@lo:41: 00000100:00100000:2.0:1788509287.234702:0:7718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cb7c83c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796697728:0@lo:1000: 00000100:00100000:2.0:1788509287.234757:0:7718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cb7c83c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796697856:0@lo:700: 00000100:00100000:2.0:1788509287.234788:0:7718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509287.234804:0:7718:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e519a4a0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509287.235116:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796697856 00000100:00100000:3.0:1788509287.235121:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796697856 00000100:00100000:3.0:1788509287.235153:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509287.235159:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a89fadfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7718:x1875387796697856:12345-0@lo:700: 00000100:00100000:3.0:1788509287.235203:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a89fadfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7718:x1875387796697856:12345-0@lo:700: Request processed in 45us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509287.235210:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509287.239450:0:7718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cb7c83c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796697856:0@lo:700: 00000100:00100000:2.0:1788509287.239622:0:7718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cb7c83c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796697984:0@lo:1000: 00000100:00100000:2.0:1788509287.239683:0:7718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509287.239719:0:7718:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f161c888 going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.240120:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796697984 00000100:00100000:1.0:1788509287.240129:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796697984 00000100:00100000:1.0:1788509287.240246:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788509287.240255:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000752f7b54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7718:x1875387796697984:12345-0@lo:1000: 00000100:00100000:1.0:1788509287.240347:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000752f7b54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7718:x1875387796697984:12345-0@lo:1000: Request processed in 93us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.240355:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788509287.240389:0:7718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cb7c83c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796697984:0@lo:1000: 00000004:00080000:1.0:1788509287.240430:0:7718:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000e519a4a0 with version 0 00000020:00100000:1.0:1788509287.240450:0:7718:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788509287.240456:0:7718:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004b1ff953 x1875387796698240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788509287.240470:0:7718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b1ff953 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796698240:0@lo:1000: 00000100:00100000:1.0:1788509287.240496:0:7718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.240512:0:7718:0:(client.c:2716:ptlrpc_set_wait()) set 00000000723dee49 going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.240522:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796698240 00000100:00100000:1.0:1788509287.240524:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796698240 00000100:00100000:1.0:1788509287.240542:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788509287.240546:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d41f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7718:x1875387796698240:12345-0@lo:1000: 00000001:00080000:1.0:1788509287.246398:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788509287.246412:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788509287.246937:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d41f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7718:x1875387796698240:12345-0@lo:1000: Request processed in 6385us (6436us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788509287.246952:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1788509287.247198:0:7718:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788509287.247204:0:7718:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788509287.247229:0:7718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b1ff953 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796698240:0@lo:1000: 00000100:00100000:1.0:1788509287.247309:0:7718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b1ff953 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796698368:0@lo:1000: 00000100:00100000:1.0:1788509287.247345:0:7718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.247375:0:7718:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047f447dc going to sleep for 11 seconds 00000100:00100000:1.0:1788509287.247392:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796698368 00000100:00100000:1.0:1788509287.247398:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796698368 00000100:00100000:1.0:1788509287.247432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788509287.247439:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0aa76fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7718:x1875387796698368:12345-0@lo:1000: 00000100:00100000:1.0:1788509287.247502:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0aa76fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7718:x1875387796698368:12345-0@lo:1000: Request processed in 64us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509287.247509:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788509287.247531:0:7718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b1ff953 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7718:1875387796698368:0@lo:1000: 00000040:00080000:1.0:1788509287.247555:0:7718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788509287.247583:0:7718:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000723dee49 with version 1 00000004:00080000:0.0:1788509287.248700:0:7716:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000966fe66d version 1 rpc_version 1 00000020:00100000:0.0:1788509287.248727:0:7716:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788509287.248736:0:7716:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ed3498fb x1875387796698624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509287.248769:0:7716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed3498fb pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7716:1875387796698624:0@lo:1000: 00000100:00100000:0.0:1788509287.248840:0:7716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509287.248867:0:7716:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cce00756 going to sleep for 11 seconds 00000100:00100000:0.0:1788509287.250371:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796698624 00000100:00100000:0.0:1788509287.250381:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796698624 00000100:00100000:0.0:1788509287.250425:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788509287.250432:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a70bd656 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7716:x1875387796698624:12345-0@lo:1000: 00000001:00080000:0.0:1788509287.253621:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788509287.253733:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a70bd656 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7716:x1875387796698624:12345-0@lo:1000: Request processed in 3298us (4890us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788509287.253745:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788509287.253793:0:7716:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788509287.253797:0:7716:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788509287.253811:0:7716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed3498fb pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7716:1875387796698624:0@lo:1000: 00000040:00080000:1.0:1788509287.254575:0:7718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788509287.254724:0:7718:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788509287.254729:0:7718:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788509287.255331:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788509287.265469:0:7727:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788509287.638339:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509287.638364:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b1ff953 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796698752:0@lo:41: 00000100:00100000:3.0:1788509287.638434:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509287.638858:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796698752 00000100:00100000:1.0:1788509287.638877:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796698752 00000100:00100000:1.0:1788509287.638959:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788509287.638969:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d604df9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796698752:12345-0@lo:41: 00000004:00000024:1.0:1788509287.639126:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788509287.639197:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d604df9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796698752:12345-0@lo:41: Request processed in 230us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509287.639372:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b1ff953 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796698752:0@lo:41: 00000100:00100000:1.0:1788509287.639434:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788509288.278068:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788509288.305887:0:7779:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509288.306382:0:7779:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788509289.304556:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509290.326762:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788509291.171409:0:7880:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509291.171618:0:7880:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788509291.359860:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788509292.098695:0:7928:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3f192310 20000000:00000080:2.0:1788509292.098711:0:7928:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bcdb57ba800 uarg=0000000000000000 20000000:01000000:2.0:1788509292.098748:0:7928:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788509292.098754:0:7928:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788509292.098764:0:7928:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788509292.098863:0:7928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788509292.098873:0:7928:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788509292.106984:0:7928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509292.107217:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788509292.107248:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788509292.107268:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788509292.107283:0:7928:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788509292.107298:0:7928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509292.107316:0:7928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd41c expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509292.107322:0:7928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd50a expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509292.107328:0:7928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509292.107364:0:7928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd50a expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509292.107377:0:7928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd50a expref: 17 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509292.107389:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d30640f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1875387796698880:0@lo:104: 00000100:00100000:3.0:1788509292.107456:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788509292.107505:0:7928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd41c expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509292.107513:0:7928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd41c expref: 17 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509292.107533:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a26040ab pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1875387796699008:0@lo:104: 00000100:00100000:3.0:1788509292.107553:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fd42585 going to sleep for 11 seconds 00000100:00100000:0.0:1788509292.107689:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788509292.107707:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509292.107727:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796698880 00000100:00100000:0.0:1788509292.107733:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796698880 00000100:00100000:0.0:1788509292.107792:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796699008 00000100:00100000:0.0:1788509292.107795:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796699008 00000100:00100000:0.0:1788509292.107808:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509292.107815:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c4b2839 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:7928:x1875387796698880:12345-0@lo:104: 00010000:00010000:0.0:1788509292.107827:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.107923:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509292.107929:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c4b2839 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:7928:x1875387796698880:12345-0@lo:104: Request processed in 114us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509292.107937:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509292.107976:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509292.107982:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed3498fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:7928:x1875387796699008:12345-0@lo:104: 00010000:00010000:0.0:1788509292.107989:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.108019:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788509292.108024:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed3498fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:7928:x1875387796699008:12345-0@lo:104: Request processed in 44us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509292.108030:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788509292.108044:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509292.108049:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.108055:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098e73e31 already unused, calling callback (0000000098267291) 10000000:00010000:0.0:1788509292.108058:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.108065:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509292.108072:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509292.108077:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788509292.108111:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.108118:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509292.108139:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.108145:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 0000000098e73e31/0xe5156b86310dd50a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd511 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.108157:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509292.108159:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.108164:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002eac3ea8 already unused, calling callback (0000000098267291) 10000000:00010000:0.0:1788509292.108166:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.109307:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509292.109315:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509292.109321:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788509292.109343:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.109349:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509292.109357:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.109373:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000002eac3ea8/0xe5156b86310dd41c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd423 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.109388:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509292.109390:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509292.109392:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509292.109399:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509292.109422:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000caf8eb10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796699136:0@lo:103: 00000100:00100000:0.0:1788509292.109473:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509292.109504:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509292.109510:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796699264:0@lo:103: 00000100:00100000:0.0:1788509292.109533:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509292.109543:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796699136 00000100:00100000:2.0:1788509292.109551:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796699136 00000100:00100000:0.0:1788509292.109560:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796699264 00000100:00100000:0.0:1788509292.109565:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796699264 00010000:00010000:2.0:1788509292.109578:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd50a expref: 19 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.109584:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd41c expref: 19 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509292.109614:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509292.109623:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6b9ed64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3644:x1875387796699136:12345-0@lo:103: 00010000:00010000:2.0:1788509292.109635:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509292.109639:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd50a expref: 19 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509292.109650:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd50a expref: 19 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509292.109667:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509292.109713:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6b9ed64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3644:x1875387796699136:12345-0@lo:103: Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509292.110716:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788509292.110731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509292.110731:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec61f1cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3644:x1875387796699264:12345-0@lo:103: 00010000:00010000:0.0:1788509292.110747:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509292.110752:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd41c expref: 18 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110765:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd41c expref: 18 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110780:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509292.110787:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000caf8eb10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796699136:0@lo:103: 00010000:00010000:0.0:1788509292.110801:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110814:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110820:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110826:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110831:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110849:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000255656b6 already unused, calling callback (00000000b73d62c5) 00010000:00010000:0.0:1788509292.110853:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509292.110859:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cd65a62d/0xe5156b86310dd511 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd50a expref: 18 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110861:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509292.110881:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509292.110883:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d30640f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1875387796698880:0@lo:104: 00010000:00010000:0.0:1788509292.110920:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509292.110921:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c760d221/0xe5156b86310dd423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd41c expref: 17 pid: 6513 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509292.110933:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a26040ab pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1875387796699008:0@lo:104: 00010000:00010000:2.0:1788509292.110959:0:7928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509292.110967:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec61f1cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3644:x1875387796699264:12345-0@lo:103: Request processed in 243us (1434us total) trans 0 rc 0/0 00010000:00010000:2.0:1788509292.110968:0:7928:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509292.110982:0:7928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509292.110982:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788509292.110991:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000255656b6/0xe5156b86310dd5a4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509292.111018:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796699264:0@lo:103: 00000100:00100000:3.0:1788509292.246378:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796699392:0@lo:400: 00000100:00100000:3.0:1788509292.246441:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509292.246492:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509292.246498:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a26040ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796699520:0@lo:400: 00000100:00100000:3.0:1788509292.246565:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509292.246596:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796699392 00000100:00100000:3.0:1788509292.246603:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796699392 00000100:00100000:3.0:1788509292.246643:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788509292.246650:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e95a8e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796699392:12345-0@lo:400: 00000100:00100000:3.0:1788509292.246698:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e95a8e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796699392:12345-0@lo:400: Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509292.246706:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788509292.246746:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000aff9f1b9 x1875387796699392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509292.246760:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aff9f1b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796699392:0@lo:400: 00000100:00100000:0.0:1788509292.246920:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509292.246929:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796699904:0@lo:41: 00000100:00100000:0.0:1788509292.246959:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509292.246985:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d30640f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796699648:0@lo:400: 00000100:00100000:0.0:1788509292.247010:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509292.247028:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509292.247033:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095b75d82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796699776:0@lo:400: 00000100:00100000:0.0:1788509292.247051:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509292.247068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796699520 00000100:00100000:0.0:1788509292.247072:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796699520 00000100:00100000:0.0:1788509292.247093:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796699904 00000100:00100000:0.0:1788509292.247095:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796699904 00000100:00100000:0.0:1788509292.247104:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796699776 00000100:00100000:0.0:1788509292.247106:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796699776 00000100:00100000:0.0:1788509292.247116:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788509292.247121:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a5fa4ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796699520:12345-0@lo:400: 00000100:00100000:0.0:1788509292.247151:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a5fa4ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796699520:12345-0@lo:400: Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509292.247156:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788509292.247167:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788509292.247242:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060752507 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796699904:12345-0@lo:41: 00000004:00000024:0.0:1788509292.247268:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788509292.247303:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060752507 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796699904:12345-0@lo:41: Request processed in 131us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509292.247309:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788509292.247320:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788509292.247325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c7027a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796699776:12345-0@lo:400: 00000100:00100000:0.0:1788509292.247365:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c7027a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796699776:12345-0@lo:400: Request processed in 41us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509292.247372:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788509292.247391:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796699648 00000100:00100000:0.0:1788509292.247394:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796699648 00000100:00100000:0.0:1788509292.247413:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509292.247419:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000444c1a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796699648:12345-0@lo:400: 00000100:00100000:0.0:1788509292.247446:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000444c1a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796699648:12345-0@lo:400: Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509292.247452:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509292.247479:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796699904:0@lo:41: 00000100:00100000:0.0:1788509292.247499:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095b75d82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796699776:0@lo:400: 00010000:00080000:0.0:1788509292.247506:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009d30640f x1875387796699648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509292.247514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d30640f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796699648:0@lo:400: 00000100:00100000:0.0:1788509292.247534:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a26040ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796699520:0@lo:400: 00010000:00010000:0.0:1788509292.375210:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509292.760954:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788509292.760978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000659b71b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796700032:0@lo:41: 00000100:00100000:2.0:1788509292.761054:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509292.761196:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796700032 00000100:00100000:1.0:1788509292.761205:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796700032 00000100:00100000:1.0:1788509292.761251:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788509292.761258:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4340ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796700032:12345-0@lo:41: 00000004:00000024:1.0:1788509292.761291:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788509292.761357:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4340ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796700032:12345-0@lo:41: Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509292.761364:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509292.764517:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000659b71b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796700032:0@lo:41: 10000000:01000000:0.0:1788509293.270490:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509293.270498:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdbbf0f800 from 1 10000000:01000000:0.0:1788509293.270502:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509293.270547:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000eb367d5e/0xe5156b86310dd5ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.270558:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000eb367d5e/0xe5156b86310dd5ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.270569:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000eb367d5e/0xe5156b86310dd5ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509293.270599:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700160:0@lo:101: 00000100:00100000:0.0:1788509293.270663:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509293.270704:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc3530c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788509293.270723:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796700160 00000100:00100000:0.0:1788509293.270730:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796700160 00000100:00100000:0.0:1788509293.270776:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788509293.270783:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000136409f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796700160:12345-0@lo:101: 00010000:00010000:0.0:1788509293.270795:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509293.270806:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce896ab9/0xe5156b86310dd5b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd5ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.270839:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce896ab9/0xe5156b86310dd5b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.270850:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce896ab9/0xe5156b86310dd5b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.270857:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce896ab9, rc 0) 00000100:00100000:0.0:1788509293.270893:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000136409f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796700160:12345-0@lo:101: Request processed in 111us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509293.270921:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788509293.270966:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700160:0@lo:101: 00010000:00010000:0.0:1788509293.270979:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000eb367d5e/0xe5156b86310dd5ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.270986:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000eb367d5e/0xe5156b86310dd5ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509293.271062:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700288:0@lo:501: 00000100:00100000:0.0:1788509293.271087:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509293.271103:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc3530c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788509293.271116:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796700288 00000100:00100000:0.0:1788509293.271119:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796700288 00000100:00100000:0.0:1788509293.271139:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788509293.271144:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a4bc263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796700288:12345-0@lo:501: 00000100:00100000:0.0:1788509293.271246:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a4bc263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796700288:12345-0@lo:501: Request processed in 101us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509293.271253:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788509293.271280:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700288:0@lo:501: 00000100:00100000:0.0:1788509293.271319:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700416:0@lo:503: 00000100:00100000:0.0:1788509293.271354:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509293.271366:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc3530c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788509293.271376:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796700416 00000100:00100000:0.0:1788509293.271379:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796700416 00000100:00100000:0.0:1788509293.271397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788509293.271401:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aeb3fe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796700416:12345-0@lo:503: 00000100:00100000:0.0:1788509293.271469:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aeb3fe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796700416:12345-0@lo:503: Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509293.271475:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788509293.271512:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700416:0@lo:503: 00000100:00100000:0.0:1788509293.274618:0:7969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7969:1875387796700544:0@lo:502: 00000100:00100000:0.0:1788509293.274696:0:7969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509293.274749:0:7969:0:(client.c:2716:ptlrpc_set_wait()) set 000000006aed3b48 going to sleep for 11 seconds 00000100:00100000:1.0:1788509293.275376:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796700544 00000100:00100000:1.0:1788509293.275385:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796700544 00000100:00100000:1.0:1788509293.275435:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788509293.275443:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069bf2492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:7969:x1875387796700544:12345-0@lo:502: 00000100:00100000:1.0:1788509293.277161:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069bf2492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:7969:x1875387796700544:12345-0@lo:502: Request processed in 1713us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509293.277175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788509293.279948:0:7969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087a4c053 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7969:1875387796700544:0@lo:502: 00000020:01000000:0.0:1788509293.279991:0:7969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509293.280001:0:7969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509293.280004:0:7969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788509293.280011:0:7969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcdbbf0f800 00000020:00000080:0.0:1788509293.280013:0:7969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788509293.280067:0:7969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7969:1875387796700672:0@lo:502: 00000100:00100000:0.0:1788509293.280314:0:7969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509293.280411:0:7969:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82a5d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509293.281238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796700672 00000100:00100000:2.0:1788509293.281247:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796700672 00000100:00100000:2.0:1788509293.281295:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788509293.281305:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:7969:x1875387796700672:12345-0@lo:502: 00000100:00100000:2.0:1788509293.281446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:7969:x1875387796700672:12345-0@lo:502: Request processed in 142us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509293.281454:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788509293.281645:0:7969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7969:1875387796700672:0@lo:502: 00000020:01000000:0.0:1788509293.281673:0:7969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509293.281680:0:7969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509293.281682:0:7969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788509293.281687:0:7969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788509293.282074:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788509293.282091:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788509293.282098:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509293.282107:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509293.282122:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788509293.282125:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd82e88800 from 1 10000000:01000000:2.0:1788509293.282127:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788509293.282156:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509293.282173:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509293.282182:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509293.282199:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700800:0@lo:101: 00000100:00100000:2.0:1788509293.282426:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509293.284036:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788509293.284453:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796700800 00000100:00100000:0.0:1788509293.284461:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796700800 00000100:00100000:0.0:1788509293.284552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788509293.284563:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796700800:12345-0@lo:101: 00010000:00010000:0.0:1788509293.284578:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509293.284597:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd5b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.284624:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.284634:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.284643:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030000, rc 0) 00000100:00100000:0.0:1788509293.284709:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796700800:12345-0@lo:101: Request processed in 147us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509293.284716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788509293.284853:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700800:0@lo:101: 00010000:00010000:2.0:1788509293.284868:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509293.284876:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509293.285026:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700928:0@lo:501: 00000100:00100000:2.0:1788509293.285057:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509293.285117:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788509293.285306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796700928 00000100:00100000:1.0:1788509293.285312:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796700928 00000100:00100000:1.0:1788509293.285344:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788509293.285351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796700928:12345-0@lo:501: 00000100:00100000:1.0:1788509293.285576:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796700928:12345-0@lo:501: Request processed in 225us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509293.285583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788509293.285641:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796700928:0@lo:501: 00000100:00100000:2.0:1788509293.285668:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796701056:0@lo:503: 00000100:00100000:2.0:1788509293.285711:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509293.285732:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788509293.285771:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796701056 00000100:00100000:1.0:1788509293.285775:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796701056 00000100:00100000:1.0:1788509293.285802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788509293.285809:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796701056:12345-0@lo:503: 00000100:00100000:1.0:1788509293.285890:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796701056:12345-0@lo:503: Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509293.285919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788509293.286068:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796701056:0@lo:503: 00000100:00100000:0.0:1788509293.290805:0:7973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7973:1875387796701184:0@lo:502: 00000100:00100000:0.0:1788509293.290894:0:7973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509293.290956:0:7973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82a5d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788509293.291072:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796701184 00000100:00100000:2.0:1788509293.291079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796701184 00000100:00100000:2.0:1788509293.291127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788509293.291239:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:7973:x1875387796701184:12345-0@lo:502: 00000100:00100000:2.0:1788509293.291425:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:7973:x1875387796701184:12345-0@lo:502: Request processed in 190us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509293.291433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788509293.291513:0:7973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7973:1875387796701184:0@lo:502: 00000020:01000000:0.0:1788509293.291781:0:7973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509293.291790:0:7973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509293.291793:0:7973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788509293.291800:0:7973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcd82e88800 00000020:00000080:0.0:1788509293.291803:0:7973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788509293.291825:0:7973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7973:1875387796701312:0@lo:502: 00000100:00100000:0.0:1788509293.291871:0:7973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509293.292020:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796701312 00000100:00100000:2.0:1788509293.292025:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796701312 00000100:00100000:2.0:1788509293.292057:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788509293.292064:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:7973:x1875387796701312:12345-0@lo:502: 00000100:00100000:0.0:1788509293.292213:0:7973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82a5d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788509293.292228:0:7973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:7973:1875387796701312:0@lo:502: 00000020:01000000:0.0:1788509293.292248:0:7973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509293.292252:0:7973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509293.292254:0:7973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788509293.292258:0:7973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:2.0:1788509293.292427:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:7973:x1875387796701312:12345-0@lo:502: Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509293.292435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000020:01000000:0.0:1788509293.293034:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788509293.293060:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509293.293070:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.293082:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509293.398207:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509294.422127:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509295.446111:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509296.472205:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509297.366513:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796701568:0@lo:400: 00000100:00100000:3.0:1788509297.366529:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796701696:0@lo:400: 00000100:00100000:2.0:1788509297.366578:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509297.366619:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509297.366639:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788509297.366648:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796701440:0@lo:400: 00000100:00100000:3.0:1788509297.366656:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509297.366664:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796701824:0@lo:400: 00000100:00100000:2.0:1788509297.366683:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509297.366692:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509297.366714:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796701952:0@lo:400: 00000100:00100000:3.0:1788509297.366741:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796701696 00000100:00100000:2.0:1788509297.366741:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509297.366749:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796701696 00000100:00100000:2.0:1788509297.366779:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796701568 00000100:00100000:3.0:1788509297.366789:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796701952 00000100:00100000:2.0:1788509297.366792:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796701568 00000100:00100000:3.0:1788509297.366794:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796701952 00000100:00100000:3.0:1788509297.366825:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788509297.366833:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796701696:12345-0@lo:400: 00000100:00100000:2.0:1788509297.366841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796701824 00000100:00100000:2.0:1788509297.366846:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796701824 00000100:00100000:2.0:1788509297.366865:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788509297.366874:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796701568:12345-0@lo:400: 00000100:00100000:3.0:1788509297.366888:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796701696:12345-0@lo:400: Request processed in 55us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509297.366915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788509297.366932:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788509297.366943:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796701952:12345-0@lo:400: 00000100:00100000:2.0:1788509297.366944:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796701568:12345-0@lo:400: Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509297.366955:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788509297.366974:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788509297.366979:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796701952:12345-0@lo:400: Request processed in 39us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509297.366986:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796701824:12345-0@lo:400: 00000100:00100000:3.0:1788509297.366991:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788509297.367022:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796701824:12345-0@lo:400: Request processed in 39us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509297.367029:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788509297.367039:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd891f9f80 x1875387796701824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509297.367050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796701440 00000100:00100000:3.0:1788509297.367054:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796701824:0@lo:400: 00000100:00100000:2.0:1788509297.367056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796701440 00000100:00100000:3.0:1788509297.367073:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796701696:0@lo:400: 00000100:00100000:2.0:1788509297.367089:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788509297.367097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3645:x1875387796701440:12345-0@lo:400: 00000100:00100000:3.0:1788509297.367125:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796701952:0@lo:400: 00000100:00100000:2.0:1788509297.367132:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3645:x1875387796701440:12345-0@lo:400: Request processed in 35us (448us total) trans 0 rc 0/0 00010000:00080000:3.0:1788509297.367139:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd891f8a80 x1875387796701568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509297.367140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788509297.367152:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796701568:0@lo:400: 00000100:00100000:3.0:1788509297.367172:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796701440:0@lo:400: 00000100:00100000:0.0:1788509297.367562:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796702080:0@lo:41: 00000100:00100000:0.0:1788509297.367603:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509297.367698:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796702080 00000100:00100000:1.0:1788509297.367702:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796702080 00000100:00100000:1.0:1788509297.367735:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788509297.367741:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796702080:12345-0@lo:41: 00000004:00000024:1.0:1788509297.367763:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788509297.380390:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796702080:12345-0@lo:41: Request processed in 12637us (12774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509297.380406:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788509297.380880:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796702080:0@lo:41: 00010000:00010000:2.0:1788509297.495833:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509297.878113:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796702208:0@lo:41: 00000100:00100000:1.0:1788509297.878225:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509297.878335:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796702208 00000100:00100000:1.0:1788509297.878344:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796702208 00000100:00100000:1.0:1788509297.878395:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788509297.878404:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796702208:12345-0@lo:41: 00000004:00000024:1.0:1788509297.878444:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788509297.878494:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796702208:12345-0@lo:41: Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509297.878500:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788509297.878554:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796702208:0@lo:41: 00010000:00010000:3.0:1788509298.522230:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509299.542139:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509300.580053:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509301.592306:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788509302.289811:0:8429:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788509302.289816:0:8429:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788509302.289818:0:8429:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788509302.290716:0:8429:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bcd913e8000 00000020:01000004:1.0:1788509302.290738:0:8429:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788509302.290753:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788509302.290782:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8bcdbd058000) 00000020:00000080:1.0:1788509302.290808:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788509302.344762:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788509302.344831:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788509302.404362:0:8429:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788509302.404569:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788509302.404581:0:8429:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788509302.406080:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe5156b86310dd5ce 00000020:01000004:2.0:1788509302.406093:0:8429:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788509302.406121:0:8429:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788509302.406135:0:8429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788509302.406142:0:8429:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788509302.406147:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788509302.406163:0:8429:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8bcdb4620000) 00000020:00000080:2.0:1788509302.406178:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788509302.409188:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509302.409422:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788509302.409430:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788509302.413710:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788509302.413726:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788509302.420126:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788509302.420139:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788509302.426285:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788509302.426510:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788509302.426517:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788509302.428690:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788509302.428703:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788509302.471462:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509302.471712:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788509302.471719:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788509302.478551:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788509302.478565:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788509302.483691:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788509302.483709:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788509302.486376:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796702720:0@lo:400: 00000100:00100000:2.0:1788509302.486470:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.486525:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788509302.486533:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796702336:0@lo:400: 00000100:00100000:2.0:1788509302.486620:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.486643:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796702848:0@lo:400: 00000100:00100000:2.0:1788509302.486669:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.486697:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796702464:0@lo:400: 00000100:00100000:2.0:1788509302.486721:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.486754:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509302.486760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796702592:0@lo:400: 00000100:00100000:2.0:1788509302.486808:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.486851:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796702720 00000100:00100000:2.0:1788509302.486858:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796702720 00000100:00100000:2.0:1788509302.486917:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796702464 00000100:00100000:2.0:1788509302.486920:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796702464 00000100:00100000:2.0:1788509302.486938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788509302.486946:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796702720:12345-0@lo:400: 00000100:00100000:2.0:1788509302.486998:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796702720:12345-0@lo:400: Request processed in 52us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.487006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788509302.487044:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509302.487051:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796702464:12345-0@lo:400: 00000100:00100000:2.0:1788509302.487104:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796702464:12345-0@lo:400: Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.487111:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509302.487131:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796702336 00000100:00100000:2.0:1788509302.487134:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796702336 00000100:00100000:2.0:1788509302.487166:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788509302.487173:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3646:x1875387796702336:12345-0@lo:400: 00000100:00100000:2.0:1788509302.487205:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3646:x1875387796702336:12345-0@lo:400: Request processed in 33us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.487212:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788509302.487240:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796702848 00000100:00100000:2.0:1788509302.487244:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796702848 00000100:00100000:2.0:1788509302.487260:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796702592 00000100:00100000:2.0:1788509302.487262:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796702592 00000100:00100000:2.0:1788509302.487273:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788509302.487278:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796702848:12345-0@lo:400: 00000100:00100000:2.0:1788509302.487310:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796702848:12345-0@lo:400: Request processed in 30us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.487316:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788509302.487327:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509302.487333:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796702592:12345-0@lo:400: 00000100:00100000:2.0:1788509302.487359:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796702592:12345-0@lo:400: Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.487365:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509302.487405:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796702336:0@lo:400: 00000100:00100000:2.0:1788509302.487424:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796702848:0@lo:400: 00010000:00080000:2.0:1788509302.487435:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd891f9c00 x1875387796702720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509302.487444:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796702720:0@lo:400: 00000100:00100000:1.0:1788509302.488468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796702592:0@lo:400: 00010000:00080000:1.0:1788509302.488504:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd891f9500 x1875387796702464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509302.488514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796702464:0@lo:400: 00000100:00100000:2.0:1788509302.489804:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509302.489824:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796702976:0@lo:41: 00000100:00100000:2.0:1788509302.489886:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.490010:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796702976 00000100:00100000:1.0:1788509302.490020:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796702976 00000100:00100000:1.0:1788509302.490076:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788509302.490086:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796702976:12345-0@lo:41: 00000004:00000024:1.0:1788509302.490118:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788509302.490194:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796702976:12345-0@lo:41: Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.490200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788509302.490938:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796702976:0@lo:41: 00000100:00100000:0.0:1788509302.492723:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788509302.494317:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788509302.494327:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788509302.495068:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788509302.495076:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788509302.585098:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509302.585343:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788509302.585349:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788509302.589256:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788509302.589272:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788509302.590276:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788509302.590304:0:8429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788509302.590311:0:8429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:3.0:1788509302.615652:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788509302.651358:0:8429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788509302.651397:0:8429:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788509302.651401:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788509302.651403:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788509302.651404:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509302.651405:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509302.651407:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509302.651408:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509302.651410:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509302.651411:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788509302.651412:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788509302.651414:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509302.651415:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788509302.653887:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788509302.653912:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788509302.653914:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788509302.653916:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509302.653917:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509302.653918:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509302.654152:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509302.654154:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509302.654155:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788509302.654157:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788509302.654158:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509302.654160:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788509302.654209:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788509302.654232:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796703104:0@lo:253: 00000100:00100000:0.0:1788509302.654310:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509302.654461:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e4303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509302.654701:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796703104 00000100:00100000:2.0:1788509302.654709:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796703104 00000100:00100000:2.0:1788509302.654758:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788509302.654778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:8429:x1875387796703104:12345-0@lo:253: 20000000:01000000:2.0:1788509302.654813:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788509302.654817:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788509302.654822:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788509302.654825:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788509302.656380:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788509302.656876:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788509302.656892:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788509302.656935:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788509302.657549:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788509302.657580:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788509302.657676:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788509302.657815:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788509302.657834:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:2.0:1788509302.657836:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788509302.657851:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788509302.657859:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788509302.657893:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788509302.658525:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788509302.658559:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788509302.658568:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788509302.658583:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788509302.659192:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788509302.659319:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788509302.659338:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:2.0:1788509302.659340:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788509302.659355:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788509302.659362:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788509302.659373:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788509302.659377:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788509302.659388:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788509302.659393:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788509302.659403:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788509302.659414:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788509302.660661:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788509302.660687:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:2.0:1788509302.660689:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788509302.660708:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788509302.660716:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788509302.660729:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788509302.660734:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788509302.660747:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788509302.660754:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788509302.660778:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788509302.660797:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788509302.660812:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788509302.660814:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788509302.660818:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788509302.660862:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788509302.660877:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788509302.662682:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788509302.662733:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788509302.662749:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788509302.663002:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788509302.663026:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788509302.663040:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1788509302.663050:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788509302.663053:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788509302.663739:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788509302.663938:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788509302.663961:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788509302.663975:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788509302.663984:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788509302.663986:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788509302.664813:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788509302.664840:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788509302.664853:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788509302.665049:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788509302.665068:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788509302.665081:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1788509302.665089:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788509302.665091:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788509302.665497:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788509302.665546:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788509302.665573:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788509302.665787:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788509302.665808:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788509302.665823:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1788509302.665839:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788509302.665861:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.665881:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd4a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.665889:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd518 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.665926:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd550 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.665935:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdc2073e00/0xe5156b86310dd573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd56c expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.665942:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd58f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.665956:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.665995:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd58f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.666011:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd58f expref: 18 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.666026:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796703232:0@lo:104: 00000100:00100000:2.0:1788509302.666097:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509302.666145:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdc2073e00/0xe5156b86310dd573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd56c expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.666153:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdc2073e00/0xe5156b86310dd573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd56c expref: 18 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.666161:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796703360:0@lo:104: 00000100:00100000:2.0:1788509302.666182:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509302.666206:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd550 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.666214:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd557 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd550 expref: 18 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.666222:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796703488:0@lo:104: 00000100:00100000:2.0:1788509302.666242:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509302.666284:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd518 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.666299:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd518 expref: 18 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.666307:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796703616:0@lo:104: 00000100:00100000:0.0:1788509302.666342:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796703232 00000100:00100000:0.0:1788509302.666350:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796703232 00000100:00100000:0.0:1788509302.666389:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796703360 00000100:00100000:0.0:1788509302.666392:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796703360 00000100:00100000:0.0:1788509302.666403:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796703488 00000100:00100000:0.0:1788509302.666406:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796703488 00000100:00100000:0.0:1788509302.666432:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509302.666443:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:6513:x1875387796703232:12345-0@lo:104: 00010000:00010000:0.0:1788509302.666458:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072a00/0xe5156b86310dd58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666521:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509302.666528:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:6513:x1875387796703232:12345-0@lo:104: Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.666535:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509302.666553:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509302.666560:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796703360:12345-0@lo:104: 00010000:00010000:0.0:1788509302.666568:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073200/0xe5156b86310dd56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666610:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788509302.666624:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796703360:12345-0@lo:104: Request processed in 64us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.666632:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509302.666647:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788509302.666654:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6513:x1875387796703488:12345-0@lo:104: 00010000:00010000:0.0:1788509302.666663:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666692:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788509302.666697:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6513:x1875387796703488:12345-0@lo:104: Request processed in 44us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.666704:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788509302.666722:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788509302.666729:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072a00/0xe5156b86310dd58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666736:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072a00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509302.666741:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072a00/0xe5156b86310dd58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666750:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072a00/0xe5156b86310dd58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509302.666757:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072a00/0xe5156b86310dd58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509302.666774:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509302.666802:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072a00/0xe5156b86310dd58f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666818:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509302.666840:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072a00/0xe5156b86310dd58f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666847:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072a00/0xe5156b86310dd58f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd596 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666861:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509302.666864:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073200/0xe5156b86310dd56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666869:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073200 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509302.666872:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073200/0xe5156b86310dd56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666879:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073200/0xe5156b86310dd56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509302.666885:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073200/0xe5156b86310dd56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509302.666891:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509302.666925:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073200/0xe5156b86310dd56c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666948:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509302.666961:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073200/0xe5156b86310dd56c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666968:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073200/0xe5156b86310dd56c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd573 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666984:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509302.666987:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.666992:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031400 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509302.666995:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.667002:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509302.667008:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509302.667012:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788509302.667013:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788509302.667025:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.667026:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796703872:0@lo:103: 00010000:00010000:0.0:1788509302.667031:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509302.667036:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd550 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.667042:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.667051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509302.667053:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509302.667055:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509302.667055:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509302.667093:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796704000:0@lo:103: 00000100:00100000:1.0:1788509302.667113:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.667220:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796703872 00000100:00100000:1.0:1788509302.667225:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796703872 00000100:00100000:0.0:1788509302.667270:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796704000 00000100:00100000:0.0:1788509302.667279:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796704000 00010000:00010000:0.0:1788509302.667295:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd557 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd550 expref: 20 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509302.667318:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509302.667324:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:3647:x1875387796704000:12345-0@lo:103: 00010000:00010000:0.0:1788509302.667334:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509302.667339:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd557 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd550 expref: 20 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.667348:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd557 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd550 expref: 20 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.667363:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509302.667391:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:3647:x1875387796704000:12345-0@lo:103: Request processed in 68us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.667397:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788509302.667407:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdc2073e00/0xe5156b86310dd573 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd56c expref: 19 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.667437:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788509302.667445:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3647:x1875387796703872:12345-0@lo:103: 00010000:00010000:1.0:1788509302.667453:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509302.667456:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdc2073e00/0xe5156b86310dd573 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd56c expref: 19 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.667464:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdc2073e00/0xe5156b86310dd573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd56c expref: 19 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.667473:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509302.667498:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3647:x1875387796703872:12345-0@lo:103: Request processed in 55us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.667504:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788509302.667535:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796704000:0@lo:103: 00000100:00100000:1.0:1788509302.667544:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796703872:0@lo:103: 00000100:00100000:2.0:1788509302.667930:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509302.667941:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796703744:0@lo:103: 00000100:00100000:2.0:1788509302.667971:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.668019:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509302.668046:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.668056:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd4a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 18 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.668064:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796704128:0@lo:104: 00000100:00100000:2.0:1788509302.668083:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.668097:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00540 going to sleep for 11 seconds 00000100:00100000:2.0:1788509302.668108:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796703232:0@lo:104: 00010000:00010000:2.0:1788509302.668115:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdc2073e00/0xe5156b86310dd573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd56c expref: 18 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.668125:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796703360:0@lo:104: 00010000:00010000:2.0:1788509302.668132:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd550 expref: 17 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.668139:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796703488:0@lo:104: 00000100:00100000:0.0:1788509302.668581:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796703744 00000100:00100000:0.0:1788509302.668587:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796703744 00010000:00010000:0.0:1788509302.668618:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd58f expref: 17 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509302.668642:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788509302.668650:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:3644:x1875387796703744:12345-0@lo:103: 00010000:00010000:0.0:1788509302.668660:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509302.668664:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd58f expref: 17 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.668674:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd58f expref: 17 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.668701:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd58f expref: 17 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.668711:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796703616 00010000:00010000:0.0:1788509302.668711:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509302.668715:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796703616 00000100:00100000:1.0:1788509302.668730:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796704128 00000100:00100000:1.0:1788509302.668733:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796704128 00000100:00100000:1.0:1788509302.668744:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788509302.668745:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3644:x1875387796703744:12345-0@lo:103: Request processed in 97us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.668750:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796703616:12345-0@lo:104: 00000100:00100000:0.0:1788509302.668753:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788509302.668760:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509302.668783:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788509302.668790:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796704128:12345-0@lo:104: 00010000:00010000:0.0:1788509302.668798:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072200/0xe5156b86310dd4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.668815:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509302.668820:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796703616:12345-0@lo:104: Request processed in 71us (802us total) trans 0 rc 0/0 00010000:00010000:0.0:1788509302.668821:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788509302.668825:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796704128:12345-0@lo:104: Request processed in 37us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.668827:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788509302.668831:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788509302.668844:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509302.668850:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.668856:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925a00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509302.668860:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.668868:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509302.668875:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509302.668880:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788509302.668929:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.668947:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509302.668956:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd518 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.668962:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd51f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.668973:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509302.668976:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072200/0xe5156b86310dd4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.668982:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072200 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509302.668985:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072200/0xe5156b86310dd4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.668990:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072200/0xe5156b86310dd4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509302.668996:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072200/0xe5156b86310dd4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509302.669001:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788509302.669013:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072200/0xe5156b86310dd4a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.669019:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509302.669023:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072200/0xe5156b86310dd4a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.669029:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072200/0xe5156b86310dd4a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd4a8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.669049:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509302.669051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509302.669052:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509302.669121:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509302.669133:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796704384:0@lo:103: 00000100:00100000:3.0:1788509302.669164:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509302.669199:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509302.669205:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796704256:0@lo:103: 00000100:00100000:3.0:1788509302.669225:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509302.669262:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796704384 00000100:00100000:3.0:1788509302.669266:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796704384 00010000:00010000:3.0:1788509302.669283:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd4a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 16 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509302.669300:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796704256 00000100:00100000:3.0:1788509302.669303:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796704256 00010000:00010000:3.0:1788509302.669313:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd51f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd518 expref: 17 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509302.669324:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509302.669329:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:3645:x1875387796704384:12345-0@lo:103: 00010000:00010000:3.0:1788509302.669336:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509302.669339:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd4a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 17 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669347:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd4a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 17 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669356:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509302.669383:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:3645:x1875387796704384:12345-0@lo:103: Request processed in 54us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509302.669397:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509302.669409:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509302.669414:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3645:x1875387796704256:12345-0@lo:103: 00010000:00010000:3.0:1788509302.669421:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509302.669425:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd51f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd518 expref: 16 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669435:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd518 expref: 16 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669446:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669453:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669466:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669472:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669478:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669483:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669488:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509302.669492:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669504:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669512:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.669520:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509302.669543:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3645:x1875387796704256:12345-0@lo:103: Request processed in 129us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509302.669549:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509302.669672:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796704256:0@lo:103: 00000100:00100000:3.0:1788509302.669682:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796704384:0@lo:103: 00000100:00100000:2.0:1788509302.674722:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796703744:0@lo:103: 00010000:00010000:2.0:1788509302.674821:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd518 expref: 15 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.674838:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796703616:0@lo:104: 00010000:00010000:2.0:1788509302.674848:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd4a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd4a1 expref: 14 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.674855:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796704128:0@lo:104: 00010000:00010000:2.0:1788509302.674885:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.674895:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.674949:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.674955:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd5dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788509302.674969:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788509302.681751:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:8429:x1875387796703104:12345-0@lo:253: Request processed in 26975us (27431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.681775:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788509302.681879:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796703104:0@lo:253: 10000000:01000000:0.0:1788509302.681894:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788509302.681924:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788509302.681926:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788509302.681928:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509302.681929:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788509302.681930:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509302.681932:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509302.681933:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509302.681935:0:8429:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788509302.681937:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509302.681938:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788509302.681975:0:8429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bcd913e8000 from lustre-OST0000 10000000:01000000:0.0:1788509302.682004:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788509302.682019:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788509302.682028:0:8429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bcd9e5d99c0 local copy 10000000:01000000:0.0:1788509302.682032:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788509302.682069:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.682081:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.682089:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509302.682107:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796704512:0@lo:101: 00000100:00100000:0.0:1788509302.682146:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509302.682178:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e430540 going to sleep for 11 seconds 00000100:00100000:2.0:1788509302.682278:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796704512 00000100:00100000:2.0:1788509302.682285:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796704512 00000100:00100000:2.0:1788509302.682339:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788509302.682346:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+13:8429:x1875387796704512:12345-0@lo:101: 00010000:00010000:2.0:1788509302.682360:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509302.682380:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310dd5ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd5e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.682404:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310dd5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd5e3 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.682414:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310dd5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd5e3 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.682422:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226e00, rc 0) 00000100:00100000:2.0:1788509302.682462:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796704512:12345-0@lo:101: Request processed in 117us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.682469:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788509302.682537:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796704512:0@lo:101: 00010000:00010000:1.0:1788509302.682550:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.682570:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.682680:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796704640:0@lo:501: 00000100:00100000:1.0:1788509302.682707:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.682737:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb446b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.682789:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796704640 00000100:00100000:0.0:1788509302.682793:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796704640 00000100:00100000:0.0:1788509302.682829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788509302.682835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796704640:12345-0@lo:501: 00000100:00100000:0.0:1788509302.682893:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796704640:12345-0@lo:501: Request processed in 58us (185us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788509302.682923:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788509302.682995:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796704640:0@lo:501: 10000000:01000000:1.0:1788509302.683007:0:8429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788509302.683025:0:8429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788509302.683031:0:8429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.683038:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.683045:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.683068:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788509302.683097:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bcd913e8000 10000000:01000000:1.0:1788509302.683101:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788509302.683106:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788509302.683108:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788509302.683113:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788509302.683115:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788509302.683131:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.683139:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.683146:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.683157:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796704768:0@lo:101: 00000100:00100000:1.0:1788509302.683182:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.683196:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb446b180 going to sleep for 11 seconds 00010000:00010000:0.0:1788509302.683239:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509302.683245:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.683253:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590aa00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509302.683256:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.683276:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509302.683283:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509302.683288:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509302.683307:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.683314:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509302.683337:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.683344:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd5e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd5ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.683357:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509302.683359:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509302.683361:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509302.683371:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796704768 00000100:00100000:0.0:1788509302.683374:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796704768 00000100:00100000:0.0:1788509302.683394:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788509302.683400:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796704768:12345-0@lo:101: 00010000:00010000:0.0:1788509302.683408:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509302.683416:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd5f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.683432:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.683448:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.683455:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a400, rc 0) 00000100:00100000:0.0:1788509302.683483:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796704768:12345-0@lo:101: Request processed in 82us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.683488:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788509302.683588:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796704896:0@lo:103: 00000100:00100000:1.0:1788509302.683617:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.683671:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796704768:0@lo:101: 00010000:00010000:1.0:1788509302.683682:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.683690:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.683744:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705024:0@lo:501: 00000100:00100000:1.0:1788509302.683779:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.683804:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb446b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.683844:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796705024 00000100:00100000:0.0:1788509302.683849:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796705024 00000100:00100000:0.0:1788509302.683879:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788509302.683885:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705024:12345-0@lo:501: 00000100:00100000:0.0:1788509302.683995:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705024:12345-0@lo:501: Request processed in 110us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.684002:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788509302.684064:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796704896 00000100:00100000:2.0:1788509302.684068:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796704896 00000100:00100000:2.0:1788509302.684107:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509302.684114:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:3646:x1875387796704896:12345-0@lo:103: 00010000:00010000:2.0:1788509302.684123:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509302.684135:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310dd5ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd5e3 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509302.684146:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509302.684177:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:3646:x1875387796704896:12345-0@lo:103: Request processed in 65us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.684184:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509302.684210:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796704896:0@lo:103: 00000100:00100000:1.0:1788509302.684323:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705024:0@lo:501: 00000100:00100000:1.0:1788509302.684349:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705152:0@lo:503: 00000100:00100000:1.0:1788509302.684397:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.684422:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb446b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.684461:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796705152 00000100:00100000:0.0:1788509302.684465:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796705152 00000100:00100000:0.0:1788509302.684496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788509302.684503:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796705152:12345-0@lo:503: 00000100:00100000:0.0:1788509302.684592:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796705152:12345-0@lo:503: Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.684598:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788509302.684667:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705152:0@lo:503: 00000040:00080000:2.0:1788509302.684958:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788509302.685028:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705280:0@lo:502: 00000100:00100000:2.0:1788509302.685064:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.685083:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00540 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.685141:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796705280 00000100:00100000:0.0:1788509302.685145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796705280 00000100:00100000:0.0:1788509302.685177:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788509302.685184:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796705280:12345-0@lo:502: 00000100:00100000:0.0:1788509302.685257:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796705280:12345-0@lo:502: Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.685271:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788509302.685383:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705280:0@lo:502: 00000040:00080000:2.0:1788509302.685556:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788509302.685582:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788509302.685596:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788509302.685609:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788509302.685621:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788509302.685633:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788509302.685653:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705408:0@lo:502: 00000100:00100000:2.0:1788509302.685689:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.685743:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00540 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.688894:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796705408 00000100:00100000:0.0:1788509302.688921:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796705408 00000100:00100000:1.0:1788509302.689181:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788509302.689198:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796705408:12345-0@lo:502: 00000100:00100000:1.0:1788509302.689394:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796705408:12345-0@lo:502: Request processed in 202us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.689402:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788509302.689752:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705408:0@lo:502: 00000040:00080000:0.0:1788509302.689861:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788509302.689876:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788509302.691207:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788509302.691217:0:8452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788509302.691225:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509302.691227:0:8452:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788509302.691234:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509302.691252:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8bcdbd0599c0) 00000020:00000080:1.0:1788509302.691276:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788509302.691282:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788509302.691362:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcd913e8000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788509302.691370:0:8452:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788509302.691377:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe5156b86310dd606 00010000:00010000:1.0:1788509302.696447:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788509302.696796:0:8452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788509302.700528:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788509302.700961:0:8452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788509302.706009:0:8452:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788509302.706210:0:8452:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788509302.712200:0:8452:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788509302.713659:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788509302.713672:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509302.713678:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509302.713680:0:8452:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788509302.713684:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509302.713688:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509302.713689:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788509302.713692:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788509302.713694:0:8452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788509302.713716:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509302.713718:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509302.713720:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788509302.713723:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788509302.714047:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788509302.714075:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788509302.714095:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.714119:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509302.714127:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd913e8000 from 1 10000000:01000000:0.0:1788509302.714130:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509302.714166:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.714180:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.714190:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509302.714212:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705536:0@lo:101: 00000100:00100000:0.0:1788509302.714281:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509302.714317:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e430a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509302.714452:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796705536 00000100:00100000:3.0:1788509302.714459:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796705536 00000100:00100000:3.0:1788509302.714510:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788509302.714521:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:8429:x1875387796705536:12345-0@lo:101: 00010000:00010000:3.0:1788509302.714534:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509302.714547:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd60d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.714572:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd60d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.714584:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd60d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.714594:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92925c00, rc 0) 00000100:00100000:3.0:1788509302.714704:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705536:12345-0@lo:101: Request processed in 184us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509302.714711:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788509302.714816:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705536:0@lo:101: 00010000:00010000:0.0:1788509302.714840:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.714851:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509302.714966:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705664:0@lo:501: 00000100:00100000:0.0:1788509302.714997:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509302.715071:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e430a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509302.715219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796705664 00000100:00100000:3.0:1788509302.715225:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796705664 00000100:00100000:3.0:1788509302.715286:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788509302.715294:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705664:12345-0@lo:501: 00000100:00100000:3.0:1788509302.715404:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705664:12345-0@lo:501: Request processed in 110us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509302.715412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788509302.715465:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705664:0@lo:501: 00000100:00100000:0.0:1788509302.715502:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705792:0@lo:503: 00000100:00100000:0.0:1788509302.715545:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.715741:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796705792 00000100:00100000:2.0:1788509302.715746:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796705792 00000100:00100000:2.0:1788509302.715779:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788509302.715786:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705792:12345-0@lo:503: 00000100:00100000:2.0:1788509302.715875:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705792:12345-0@lo:503: Request processed in 89us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.715882:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788509302.718089:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e430a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.718200:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705792:0@lo:503: 00000040:00080000:0.0:1788509302.718501:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788509302.718715:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705920:0@lo:502: 00000100:00100000:0.0:1788509302.718802:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509302.718873:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e430a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509302.718983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796705920 00000100:00100000:2.0:1788509302.718990:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796705920 00000100:00100000:2.0:1788509302.719089:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788509302.719108:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705920:12345-0@lo:502: 00000100:00100000:2.0:1788509302.719225:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796705920:12345-0@lo:502: Request processed in 127us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509302.719233:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788509302.719366:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796705920:0@lo:502: 00000040:00080000:0.0:1788509302.719572:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788509302.719611:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788509302.719636:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706048:0@lo:502: 00000100:00100000:0.0:1788509302.719674:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509302.719886:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796706048 00000100:00100000:3.0:1788509302.719891:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796706048 00000100:00100000:3.0:1788509302.719936:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788509302.719944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796706048:12345-0@lo:502: 00000100:00100000:3.0:1788509302.720019:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796706048:12345-0@lo:502: Request processed in 75us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509302.720025:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788509302.720831:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e430a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.720854:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706048:0@lo:502: 00000040:00080000:1.0:1788509302.721204:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788509302.721225:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788509302.722470:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509302.722481:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509302.722484:0:8456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788509302.722491:0:8456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcd913e8000 00000020:00000080:1.0:1788509302.722494:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509302.722505:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509302.722507:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509302.722509:0:8456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788509302.722511:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788509302.722785:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788509302.722817:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509302.722841:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.722853:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509302.723163:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788509302.723167:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bcd913e8000 10000000:01000000:1.0:1788509302.723171:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bcd913e8000 10000000:01000000:1.0:1788509302.723175:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788509302.723181:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd913e8000 from 1 10000000:01000000:1.0:1788509302.723184:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788509302.723219:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.723229:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.723360:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.723383:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706176:0@lo:101: 00000100:00100000:1.0:1788509302.723443:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.723493:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb446bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509302.723806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796706176 00000100:00100000:3.0:1788509302.723813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796706176 00000100:00100000:3.0:1788509302.723869:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788509302.723879:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8429:x1875387796706176:12345-0@lo:101: 00010000:00010000:3.0:1788509302.723893:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509302.723928:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd61b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.723956:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd61b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.723979:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd61b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.723990:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92925600, rc 0) 00000100:00100000:3.0:1788509302.724045:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706176:12345-0@lo:101: Request processed in 167us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509302.724051:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788509302.724257:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706176:0@lo:101: 00010000:00010000:1.0:1788509302.724273:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.724292:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.724385:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706304:0@lo:501: 00000100:00100000:1.0:1788509302.724413:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.724486:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb446bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.724521:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796706304 00000100:00100000:0.0:1788509302.724526:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796706304 00000100:00100000:0.0:1788509302.724560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788509302.724568:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706304:12345-0@lo:501: 00000100:00100000:0.0:1788509302.724672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706304:12345-0@lo:501: Request processed in 105us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.724679:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788509302.724784:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706304:0@lo:501: 00000100:00100000:1.0:1788509302.724810:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706432:0@lo:503: 00000100:00100000:1.0:1788509302.724849:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.724870:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb446bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509302.725011:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796706432 00000100:00100000:0.0:1788509302.725016:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796706432 00000100:00100000:0.0:1788509302.725077:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788509302.725083:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706432:12345-0@lo:503: 00000100:00100000:0.0:1788509302.725181:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706432:12345-0@lo:503: Request processed in 96us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.725187:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788509302.725263:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706432:0@lo:503: 00000040:00080000:2.0:1788509302.725490:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788509302.725562:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706560:0@lo:502: 00000100:00100000:2.0:1788509302.725597:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509302.725745:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509302.725788:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796706560 00000100:00100000:1.0:1788509302.725793:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796706560 00000100:00100000:1.0:1788509302.725817:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788509302.725824:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706560:12345-0@lo:502: 00000100:00100000:1.0:1788509302.725939:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706560:12345-0@lo:502: Request processed in 115us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.725946:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788509302.726188:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706560:0@lo:502: 00000040:00080000:2.0:1788509302.726469:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788509302.726493:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788509302.726504:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788509302.726513:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788509302.726522:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788509302.726532:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788509302.726541:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788509302.726550:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788509302.726559:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788509302.726568:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788509302.726672:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788509302.726740:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788509302.726750:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788509302.726760:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788509302.726785:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788509302.726796:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788509302.726806:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788509302.726815:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788509302.726826:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788509302.726838:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788509302.726849:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788509302.726856:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788509302.726864:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788509302.726871:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788509302.726877:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788509302.726884:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788509302.726892:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788509302.727388:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788509302.727403:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788509302.727412:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788509302.727422:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788509302.727431:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788509302.727440:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788509302.727449:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788509302.727459:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788509302.727468:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788509302.727477:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788509302.727506:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706688:0@lo:502: 00000100:00100000:2.0:1788509302.727561:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.727610:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796706688 00000100:00100000:1.0:1788509302.727618:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796706688 00000100:00100000:1.0:1788509302.727699:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788509302.727708:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706688:12345-0@lo:502: 00000100:00100000:1.0:1788509302.727822:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796706688:12345-0@lo:502: Request processed in 115us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.727829:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788509302.728291:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509302.728311:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796706688:0@lo:502: 00000040:00080000:2.0:1788509302.728366:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788509302.728384:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788509302.729176:0:8457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788509302.729206:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8bcc86303380) 00000020:00000080:1.0:1788509302.729229:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788509302.729314:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcd913e8000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788509302.729318:0:8457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcd913e8000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788509302.729321:0:8457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd913e8000 3 00010000:00080000:1.0:1788509302.729367:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc86312000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509302.738532:0:8457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788509302.738807:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788509302.738858:0:8457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788509302.738872:0:8457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe5156b86310dd630 00000100:00080000:1.0:1788509302.738885:0:8457:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788509302.738891:0:8457:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8bcc86312000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509302.738959:0:8457:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913e7100 x1875387796706816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509302.738980:0:8457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788509302.739050:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796706816:0@lo:38: 00000100:00100000:2.0:1788509302.739123:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.739281:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796706816 00000100:00100000:1.0:1788509302.739290:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796706816 00000100:00100000:1.0:1788509302.739332:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509302.739338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875387796706816:12345-0@lo:38: 00010000:00080000:1.0:1788509302.739361:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788509302.739403:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe5156b86310dd637 00000004:00100000:1.0:1788509302.739419:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788509302.739449:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8bcc86317000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509302.739524:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875387796706816:12345-0@lo:38: Request processed in 184us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.739532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788509302.739566:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd913e7100 x1875387796706816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509302.739576:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509302.739583:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788509302.739591:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788509302.739607:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788509302.739610:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc86312000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788509302.739615:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796706816:0@lo:38: 00000020:01000004:1.0:1788509302.740110:0:8457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788509302.740140:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8bcc86300000) 00000020:00000080:1.0:1788509302.740165:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788509302.740240:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcd913e8000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788509302.740245:0:8457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcd913e8000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788509302.740247:0:8457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd913e8000 3 00010000:00080000:1.0:1788509302.740282:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc86311800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509302.741846:0:8457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788509302.742109:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788509302.742153:0:8457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788509302.742167:0:8457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe5156b86310dd645 00000100:00080000:1.0:1788509302.742177:0:8457:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788509302.742183:0:8457:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8bcc86311800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509302.742219:0:8457:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913e7800 x1875387796706944/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509302.742236:0:8457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788509302.743370:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875387796706944:0@lo:38: 00000100:00100000:0.0:1788509302.743437:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509302.743505:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796706944 00000100:00100000:0.0:1788509302.743513:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796706944 00000100:00100000:0.0:1788509302.743560:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788509302.743567:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796706944:12345-0@lo:38: 00010000:00080000:0.0:1788509302.743716:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1788509302.743754:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe5156b86310dd64c 00000004:00100000:0.0:1788509302.743778:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788509302.743809:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509302.743860:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875387796706944:12345-0@lo:38: Request processed in 292us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509302.743867:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788509302.743940:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd913e7800 x1875387796706944/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509302.743951:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509302.743958:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788509302.743965:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788509302.743970:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788509302.743972:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc86311800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788509302.743978:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875387796706944:0@lo:38: 00000040:00080000:3.0:1788509302.747399:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788509302.748010:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788509302.748048:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509302.748067:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.748080:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788509302.748135:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788509302.748137:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788509302.748139:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509302.748141:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509302.748142:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509302.748144:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509302.748146:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788509302.748147:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788509302.748149:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788509302.748150:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509302.748152:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788509302.748156:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788509302.748159:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788509302.748161:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788509302.748162:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509302.748163:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509302.748169:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509302.748170:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509302.748171:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788509302.748172:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788509302.748173:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788509302.748174:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509302.748175:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788509302.748201:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788509302.748222:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796707072:0@lo:253: 00000100:00100000:3.0:1788509302.748284:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509302.748431:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509302.751421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796707072 00000100:00100000:2.0:1788509302.751434:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796707072 00000100:00100000:2.0:1788509302.751495:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788509302.751505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:8429:x1875387796707072:12345-0@lo:253: 20000000:01000000:2.0:1788509302.751535:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788509302.751548:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788509302.761739:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788509302.761771:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788509302.761957:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788509302.761963:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788509302.761987:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762005:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd542 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762013:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd55e expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762019:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762058:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd55e expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762071:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd565 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd55e expref: 16 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509302.762084:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796707200:0@lo:104: 00000100:00100000:3.0:1788509302.762163:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788509302.762223:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd542 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762232:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd542 expref: 16 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509302.762240:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfda300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796707328:0@lo:104: 00000100:00100000:3.0:1788509302.762259:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509302.762283:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788509302.762313:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509302.762336:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796707200 00000100:00100000:3.0:1788509302.762344:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796707200 00000100:00100000:3.0:1788509302.762384:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796707328 00000100:00100000:3.0:1788509302.762387:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796707328 00000100:00100000:3.0:1788509302.762401:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788509302.762409:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd3b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6536:x1875387796707200:12345-0@lo:104: 00010000:00010000:3.0:1788509302.762421:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073600/0xe5156b86310dd55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762568:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509302.762575:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd3b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6536:x1875387796707200:12345-0@lo:104: Request processed in 166us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509302.762582:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788509302.762624:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788509302.762630:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6536:x1875387796707328:12345-0@lo:104: 00010000:00010000:3.0:1788509302.762638:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762670:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788509302.762682:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6536:x1875387796707328:12345-0@lo:104: Request processed in 52us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509302.762687:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788509302.762708:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788509302.762714:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073600/0xe5156b86310dd55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762721:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509302.762725:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073600/0xe5156b86310dd55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762734:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073600/0xe5156b86310dd55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788509302.762740:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073600/0xe5156b86310dd55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509302.762746:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788509302.762785:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073600/0xe5156b86310dd55e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762792:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509302.762810:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073600/0xe5156b86310dd55e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762816:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073600/0xe5156b86310dd55e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd565 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762830:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509302.762834:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762850:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924e00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509302.762852:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762859:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788509302.762864:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509302.762870:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788509302.762883:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762888:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509302.762922:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd542 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762928:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd549 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.762940:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509302.762942:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509302.762944:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509302.762949:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509302.762961:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796707456:0@lo:103: 00000100:00100000:3.0:1788509302.762989:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509302.763020:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509302.763026:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796707584:0@lo:103: 00000100:00100000:3.0:1788509302.763054:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509302.763083:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796707456 00000100:00100000:3.0:1788509302.763087:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796707456 00000100:00100000:2.0:1788509302.765994:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796707200:0@lo:104: 00000100:00100000:2.0:1788509302.766011:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfda300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796707328:0@lo:104: 00010000:00010000:2.0:1788509302.766039:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.766176:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd565 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd55e expref: 17 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.767002:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796707584 00000100:00100000:0.0:1788509302.767004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:8429:x1875387796707072:12345-0@lo:253: Request processed in 15497us (18715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.767011:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796707584 00000100:00100000:0.0:1788509302.767032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:1.0:1788509302.767041:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd542 expref: 18 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509302.767106:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788509302.767116:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:3645:x1875387796707584:12345-0@lo:103: 00010000:00010000:1.0:1788509302.767132:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509302.767138:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd542 expref: 17 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.767149:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd542 expref: 17 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.767170:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd542 expref: 17 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509302.767192:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509302.767249:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3645:x1875387796707584:12345-0@lo:103: Request processed in 134us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509302.767257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788509302.767275:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788509302.767289:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:3647:x1875387796707456:12345-0@lo:103: 00010000:00010000:3.0:1788509302.767299:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509302.767304:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd565 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd55e expref: 15 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767315:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd55e expref: 15 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767326:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd55e expref: 15 pid: 6515 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767338:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767347:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788509302.767362:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015788200s 00010000:00010000:3.0:1788509302.767367:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767373:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767392:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767398:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767404:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509302.767408:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767422:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767444:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509302.767470:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509302.767505:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:3647:x1875387796707456:12345-0@lo:103: Request processed in 223us (4514us total) trans 0 rc 0/0 00010000:00010000:0.0:1788509302.768281:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.768292:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509302.768298:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd653 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509302.773511:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8429:1875387796707072:0@lo:253: 10000000:01000000:2.0:1788509302.773534:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788509302.773537:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788509302.773539:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788509302.773540:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509302.773541:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509302.773542:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509302.773543:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509302.773544:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788509302.773546:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788509302.773547:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788509302.773548:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509302.773549:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788509302.773565:0:8429:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788509302.776038:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796707584:0@lo:103: 00000100:00100000:0.0:1788509302.776080:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796707456:0@lo:103: 00000100:00100000:3.0:1788509302.776200:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00080000:10000000:2.0:1788509302.780759:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788509302.780968:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788509302.781155:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788509302.781944:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788509302.782464:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788509302.782793:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788509302.785845:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788509302.802289:0:8429:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788509302.802299:0:8429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788509302.802356:0:8429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788509302.802404:0:8429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788509302.802427:0:8429:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788509302.802450:0:8429:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788509302.806023:0:8429:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509302.806253:0:8429:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788509302.999226:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796707712:0@lo:41: 00000100:00100000:3.0:1788509302.999299:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509302.999462:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796707712 00000100:00100000:1.0:1788509302.999470:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796707712 00000100:00100000:1.0:1788509303.001079:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788509303.001096:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796707712:12345-0@lo:41: 00000004:00000024:1.0:1788509303.001132:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788509303.001213:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796707712:12345-0@lo:41: Request processed in 123us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509303.001220:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788509303.007513:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796707712:0@lo:41: 00010000:00010000:1.0:1788509303.642866:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788509303.855545:0:8513:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509303.856093:0:8513:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788509304.663370:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509305.688036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509306.710017:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509307.606530:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509307.606555:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796707840:0@lo:41: 00000100:00100000:1.0:1788509307.606624:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509307.606874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796707840 00000100:00100000:3.0:1788509307.606883:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796707840 00000100:00100000:3.0:1788509307.609159:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788509307.609177:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796707840:12345-0@lo:41: 00000004:00000024:3.0:1788509307.609390:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788509307.609483:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796707840:12345-0@lo:41: Request processed in 312us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509307.609491:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509307.609580:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796707840:0@lo:41: 00010000:00010000:0.0:1788509307.738133:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509308.119280:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796707968:0@lo:41: 00000100:00100000:2.0:1788509308.119349:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.119490:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796707968 00000100:00100000:1.0:1788509308.119499:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796707968 00000100:00100000:1.0:1788509308.119552:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788509308.119562:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796707968:12345-0@lo:41: 00000004:00000024:1.0:1788509308.119592:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788509308.119646:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796707968:12345-0@lo:41: Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.119653:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788509308.122867:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796707968:0@lo:41: 10000000:01000000:3.0:1788509308.123068:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788509308.123072:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcdbbf0f800 from 30 10000000:01000000:3.0:1788509308.123076:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509308.123119:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.123130:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.123141:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509308.123161:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796708096:0@lo:101: 00000100:00100000:3.0:1788509308.123225:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.123271:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.123326:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796708096 00000100:00100000:2.0:1788509308.123333:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796708096 00000100:00100000:2.0:1788509308.123388:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788509308.123398:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:6517:x1875387796708096:12345-0@lo:101: 00010000:00010000:2.0:1788509308.123410:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509308.123424:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd65a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509308.123448:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd65a expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509308.123475:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd65a expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509308.123484:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227200, rc 0) 00000100:00100000:2.0:1788509308.123522:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796708096:12345-0@lo:101: Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.123529:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788509308.123629:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796708096:0@lo:101: 00010000:00010000:3.0:1788509308.123644:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.123653:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509308.123707:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796708224:0@lo:501: 00000100:00100000:3.0:1788509308.123746:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.123776:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.124043:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796708224 00000100:00100000:2.0:1788509308.124057:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796708224 00000100:00100000:2.0:1788509308.124126:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788509308.124137:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796708224:12345-0@lo:501: 00000100:00100000:2.0:1788509308.124353:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796708224:12345-0@lo:501: Request processed in 217us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.124361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788509308.128446:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796708224:0@lo:501: 00000100:00100000:3.0:1788509308.128513:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796708352:0@lo:503: 00000100:00100000:3.0:1788509308.128593:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.128661:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.128949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796708352 00000100:00100000:2.0:1788509308.128957:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796708352 00000100:00100000:2.0:1788509308.129005:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788509308.129014:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796708352:12345-0@lo:503: 00000100:00100000:2.0:1788509308.129133:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796708352:12345-0@lo:503: Request processed in 119us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.129142:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788509308.129248:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796708352:0@lo:503: 00000100:00100000:3.0:1788509308.129551:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796708608:0@lo:400: 00000100:00100000:3.0:1788509308.129587:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.129631:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788509308.129638:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796708480:0@lo:400: 00000100:00100000:3.0:1788509308.129660:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.129676:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796708992:0@lo:400: 00000100:00100000:3.0:1788509308.129701:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.129738:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796708608 00000100:00100000:3.0:1788509308.129743:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796708608 00000100:00100000:3.0:1788509308.129767:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796708480 00000100:00100000:3.0:1788509308.129770:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796708480 00000100:00100000:3.0:1788509308.129783:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796708992 00000100:00100000:3.0:1788509308.129785:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796708992 00000100:00100000:3.0:1788509308.129814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509308.129821:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796708608:12345-0@lo:400: 00000100:00100000:3.0:1788509308.129861:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796708608:12345-0@lo:400: Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509308.129868:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509308.129882:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509308.129889:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796708480:12345-0@lo:400: 00000100:00100000:3.0:1788509308.129951:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796708480:12345-0@lo:400: Request processed in 62us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509308.129957:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509308.129970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788509308.129977:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796708992:12345-0@lo:400: 00000100:00100000:3.0:1788509308.130004:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796708992:12345-0@lo:400: Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509308.130009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788509308.130026:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788509308.130047:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc865dd880 x1875387796708480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509308.130060:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796708480:0@lo:400: 00010000:00080000:3.0:1788509308.130070:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc865ded80 x1875387796708992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509308.130078:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796708992:0@lo:400: 00010000:00080000:3.0:1788509308.130087:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc865df100 x1875387796708608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509308.130094:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796708608:0@lo:400: 00000100:00100000:2.0:1788509308.130416:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796708736:0@lo:400: 00000100:00100000:2.0:1788509308.130451:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509308.130484:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788509308.130490:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796708864:0@lo:400: 00000100:00100000:2.0:1788509308.130510:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509308.130545:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796708864 00000100:00100000:2.0:1788509308.130549:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796708864 00000100:00100000:2.0:1788509308.130576:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788509308.130583:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796708864:12345-0@lo:400: 00000100:00100000:3.0:1788509308.130793:0:8746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8746:1875387796709120:0@lo:502: 00000100:00100000:0.0:1788509308.131784:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796708736 00000100:00100000:0.0:1788509308.131792:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796708736 00000100:00100000:0.0:1788509308.131834:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788509308.131841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796708736:12345-0@lo:400: 00000100:00100000:3.0:1788509308.131973:0:8746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.132007:0:8746:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.132097:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796708864:12345-0@lo:400: Request processed in 1513us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.132107:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788509308.132131:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509308.132140:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796709120 00000100:00100000:2.0:1788509308.132143:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796709120 00000100:00100000:2.0:1788509308.132167:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788509308.132173:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8746:x1875387796709120:12345-0@lo:502: 00000100:00100000:2.0:1788509308.132287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8746:x1875387796709120:12345-0@lo:502: Request processed in 113us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.132294:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788509308.132393:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796708736:12345-0@lo:400: Request processed in 551us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.132400:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788509308.141248:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc865df480 x1875387796708864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509308.141269:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796708864:0@lo:400: 00000100:00100000:3.0:1788509308.141294:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796708736:0@lo:400: 00000100:00100000:3.0:1788509308.141337:0:8746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8746:1875387796709120:0@lo:502: 00000100:00100000:3.0:1788509308.141408:0:8746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8746:1875387796709248:0@lo:502: 00000100:00100000:3.0:1788509308.141481:0:8746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.141517:0:8746:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd891b8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.141715:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796709248 00000100:00100000:2.0:1788509308.141723:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796709248 00000100:00100000:2.0:1788509308.141789:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788509308.141799:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8746:x1875387796709248:12345-0@lo:502: 00000100:00100000:2.0:1788509308.141953:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:8746:x1875387796709248:12345-0@lo:502: Request processed in 154us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.141961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788509308.142105:0:8746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8746:1875387796709248:0@lo:502: 00000040:00080000:1.0:1788509308.142126:0:8746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788509308.143551:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788509308.143580:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509308.143591:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.143614:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509308.143767:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788509308.143771:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcdbbf0f800 from 5 10000000:01000000:2.0:1788509308.143774:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788509308.143815:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509308.143823:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509308.143845:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509308.143866:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709376:0@lo:101: 00000100:00100000:2.0:1788509308.143951:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509308.143992:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8918cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.145861:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796709376 00000100:00100000:0.0:1788509308.145873:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796709376 00000100:00100000:0.0:1788509308.145961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788509308.145972:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796709376:12345-0@lo:101: 00010000:00010000:0.0:1788509308.145988:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509308.146007:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd668 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146045:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd668 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146057:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd668 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146066:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b400, rc 0) 00000100:00100000:0.0:1788509308.146135:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796709376:12345-0@lo:101: Request processed in 164us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.146142:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788509308.146203:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709376:0@lo:101: 00010000:00010000:0.0:1788509308.146222:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146231:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509308.146289:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709504:0@lo:256: 00000100:00100000:0.0:1788509308.146327:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.146356:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.146369:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796709504 00000100:00100000:0.0:1788509308.146373:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796709504 00000100:00100000:0.0:1788509308.146396:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788509308.146402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796709504:12345-0@lo:256: 20000000:01000000:0.0:1788509308.146415:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788509308.146431:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788509308.146434:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788509308.146510:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796709504:12345-0@lo:256: Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.146517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788509308.146546:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709504:0@lo:256: 10000000:01000000:0.0:1788509308.146584:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788509308.146591:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146612:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509308.146622:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788509308.146625:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788509308.146628:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788509308.146734:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146742:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146751:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509308.146764:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709632:0@lo:101: 00000100:00100000:0.0:1788509308.146789:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.146802:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.146814:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796709632 00000100:00100000:0.0:1788509308.146817:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796709632 00000100:00100000:0.0:1788509308.146837:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788509308.146843:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796709632:12345-0@lo:101: 00010000:00010000:0.0:1788509308.146856:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509308.146864:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd676 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146878:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd676 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146886:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd676 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146893:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a200, rc 0) 00000100:00100000:0.0:1788509308.146939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796709632:12345-0@lo:101: Request processed in 96us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.146945:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788509308.146976:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709632:0@lo:101: 00010000:00010000:0.0:1788509308.146986:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.146993:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509308.147042:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709760:0@lo:501: 00000100:00100000:0.0:1788509308.147065:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.147077:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.147088:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796709760 00000100:00100000:0.0:1788509308.147091:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796709760 00000100:00100000:0.0:1788509308.147110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788509308.147116:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796709760:12345-0@lo:501: 00000100:00100000:0.0:1788509308.147234:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796709760:12345-0@lo:501: Request processed in 117us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.147240:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788509308.147269:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709760:0@lo:501: 00000100:00100000:0.0:1788509308.147291:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709888:0@lo:503: 00000100:00100000:0.0:1788509308.147325:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.147337:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.147347:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796709888 00000100:00100000:0.0:1788509308.147350:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796709888 00000100:00100000:0.0:1788509308.147367:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788509308.147372:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796709888:12345-0@lo:503: 00000100:00100000:0.0:1788509308.147443:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796709888:12345-0@lo:503: Request processed in 70us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.147449:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788509308.147485:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796709888:0@lo:503: 00000100:00100000:0.0:1788509308.147652:0:8747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8747:1875387796710016:0@lo:502: 00000100:00100000:0.0:1788509308.147684:0:8747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.147703:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796710016 00000100:00100000:0.0:1788509308.147707:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796710016 00000100:00100000:0.0:1788509308.147742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788509308.147749:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:8747:x1875387796710016:12345-0@lo:502: 00000100:00100000:0.0:1788509308.147819:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:8747:x1875387796710016:12345-0@lo:502: Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.147826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788509308.147855:0:8747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd3986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.147872:0:8747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8747:1875387796710016:0@lo:502: 00000020:01000000:0.0:1788509308.147891:0:8747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788509308.147917:0:8747:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788509308.147925:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509308.147927:0:8747:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788509308.147933:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788509308.147937:0:8747:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:0.0:1788509308.147959:0:8747:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788509308.147961:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788509308.147978:0:8747:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8bcdbbec8000) 00000020:00000080:0.0:1788509308.147998:0:8747:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788509308.148004:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788509308.148080:0:8747:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788509308.148087:0:8747:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788509308.148094:0:8747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310dd68b 00010000:00080000:0.0:1788509308.148124:0:8747:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc810b6000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788509308.148351:0:8747:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788509308.166531:0:8747:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788509308.166557:0:8747:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788509308.166766:0:8747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788509308.167013:0:8747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788509308.167129:0:8747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788509308.167221:0:8747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788509308.172723:0:8750:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788509308.172739:0:8750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788509308.183590:0:8747:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788509308.183621:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788509308.183669:0:8747:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788509308.183695:0:8747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310dd692 00000100:00080000:1.0:1788509308.183706:0:8747:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788509308.183712:0:8747:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8bcc810b6000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509308.183760:0:8747:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913e5880 x1875387796710144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509308.183788:0:8747:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788509308.183860:0:8747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509308.183864:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509308.183867:0:8747:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788509308.183870:0:8747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509308.183874:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509308.183875:0:8747:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788509308.183878:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788509308.183879:0:8747:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788509308.183932:0:8747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8747:1875387796710272:0@lo:502: 00000100:00100000:1.0:1788509308.184015:0:8747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.184072:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796710272 00000100:00100000:1.0:1788509308.184078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796710272 00000100:00100000:1.0:1788509308.184120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788509308.184129:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:8747:x1875387796710272:12345-0@lo:502: 00000100:00100000:1.0:1788509308.184247:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:8747:x1875387796710272:12345-0@lo:502: Request processed in 117us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.184254:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788509308.184308:0:8747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84000 going to sleep for 11 seconds 00000100:00100000:1.0:1788509308.184331:0:8747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8747:1875387796710272:0@lo:502: 00000020:01000000:1.0:1788509308.184353:0:8747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509308.184358:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509308.184359:0:8747:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788509308.184362:0:8747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1788509308.184417:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788509308.184438:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788509308.184449:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.184457:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509308.184465:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788509308.184467:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd82e88800 from 30 10000000:01000000:1.0:1788509308.184470:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788509308.184492:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.184499:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.184508:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509308.184519:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796710400:0@lo:101: 00000100:00100000:1.0:1788509308.184545:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.184561:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84000 going to sleep for 11 seconds 00000100:00100000:1.0:1788509308.184575:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796710400 00000100:00100000:1.0:1788509308.184587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796710400 00000100:00100000:1.0:1788509308.184610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788509308.184616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796710400:12345-0@lo:101: 00010000:00010000:1.0:1788509308.184624:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509308.184635:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd699 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.184655:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd699 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.184666:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd699 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.184675:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8000, rc 0) 00000100:00100000:1.0:1788509308.184705:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796710400:12345-0@lo:101: Request processed in 89us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.184710:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788509308.184754:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796710400:0@lo:101: 00010000:00010000:1.0:1788509308.184766:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.184774:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509308.184814:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796710528:0@lo:501: 00000100:00100000:1.0:1788509308.184837:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.184852:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84000 going to sleep for 11 seconds 00000100:00100000:1.0:1788509308.184863:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796710528 00000100:00100000:1.0:1788509308.184866:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796710528 00000100:00100000:1.0:1788509308.184894:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788509308.184929:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796710528:12345-0@lo:501: 00000100:00100000:1.0:1788509308.185030:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796710528:12345-0@lo:501: Request processed in 102us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.185037:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788509308.185067:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796710528:0@lo:501: 00000100:00100000:1.0:1788509308.185092:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796710656:0@lo:503: 00000100:00100000:1.0:1788509308.185125:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.185147:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84000 going to sleep for 11 seconds 00000100:00100000:1.0:1788509308.185158:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796710656 00000100:00100000:1.0:1788509308.185161:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796710656 00000100:00100000:1.0:1788509308.185182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788509308.185188:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796710656:12345-0@lo:503: 00000100:00100000:1.0:1788509308.185258:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796710656:12345-0@lo:503: Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.185265:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788509308.185303:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796710656:0@lo:503: 00000100:00100000:0.0:1788509308.187217:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796710144:0@lo:8: 00000100:00100000:0.0:1788509308.187294:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.188289:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796710144 00000100:00100000:1.0:1788509308.188299:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796710144 00000100:00100000:1.0:1788509308.188584:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788509308.188593:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875387796710144:12345-0@lo:8: 00010000:00080000:1.0:1788509308.188638:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1788509308.188672:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310dd6a7 00002000:00100000:1.0:1788509308.188714:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8bcc86314000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788509308.188719:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788509308.188740:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788509308.188807:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788509308.191192:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788509308.191236:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8bcc86310800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509308.191351:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875387796710144:12345-0@lo:8: Request processed in 2753us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.191363:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788509308.196339:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e5880 x1875387796710144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788509318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509308.196356:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788509308.196366:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788509308.196375:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788509308.196381:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788509308.196384:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788509308.196410:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788509308.196416:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796710144:0@lo:8: 00000100:00100000:0.0:1788509308.196697:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875387796710784:0@lo:700: 00000100:00100000:0.0:1788509308.196769:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.196804:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.196889:0:8752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8752:1875387796710912:0@lo:502: 00000100:00100000:0.0:1788509308.197001:0:8752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.197033:0:8752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509308.198818:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796710784 00000100:00100000:3.0:1788509308.198836:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796710784 00000100:00100000:3.0:1788509308.198924:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509308.198936:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8751:x1875387796710784:12345-0@lo:700: 00000100:00100000:3.0:1788509308.199000:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1875387796711040:0@lo:700: 00000100:00100000:3.0:1788509308.199058:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.199097:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd891b8540 going to sleep for 11 seconds 00000004:00080000:2.0:1788509308.199467:0:8750:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788509308.199543:0:8750:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 205360643753ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788509308.199550:0:8750:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1788509308.199571:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509308.199589:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796711040 00000100:00100000:2.0:1788509308.199593:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796711040 00000100:00100000:2.0:1788509308.199642:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509308.199650:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1875387796711040:12345-0@lo:700: 00000004:00080000:0.0:1788509308.204677:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788509308.210765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796710912 00000100:00100000:1.0:1788509308.210782:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796710912 00000100:00100000:1.0:1788509308.210849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788509308.210859:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:8752:x1875387796710912:12345-0@lo:502: 00000100:00100000:1.0:1788509308.211081:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:8752:x1875387796710912:12345-0@lo:502: Request processed in 222us (14078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.211089:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788509308.211184:0:8752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8752:1875387796710912:0@lo:502: 00000100:00100000:1.0:1788509308.211263:0:8752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8752:1875387796711168:0@lo:502: 00000100:00100000:1.0:1788509308.211306:0:8752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.211333:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796711168 00000100:00100000:1.0:1788509308.211336:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796711168 00000100:00100000:1.0:1788509308.211359:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788509308.211367:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:8752:x1875387796711168:12345-0@lo:502: 00000100:00100000:1.0:1788509308.211428:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:8752:x1875387796711168:12345-0@lo:502: Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.211435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788509308.211473:0:8752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509308.211485:0:8752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8752:1875387796711168:0@lo:502: 00000040:00080000:1.0:1788509308.211503:0:8752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788509308.214973:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788509308.215014:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509308.215025:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.215038:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509308.215048:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788509308.215051:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd82e88800 from 5 10000000:01000000:3.0:1788509308.215054:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788509308.215098:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.215106:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.215185:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509308.215220:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711296:0@lo:101: 00000100:00100000:3.0:1788509308.215378:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.215430:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd891b8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788509308.215451:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796711296 00000100:00100000:3.0:1788509308.215458:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796711296 00000100:00100000:3.0:1788509308.215498:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788509308.215506:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796711296:12345-0@lo:101: 00010000:00010000:3.0:1788509308.215526:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509308.215537:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd6ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.215562:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.215572:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.215580:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924600, rc 0) 00000100:00100000:3.0:1788509308.215618:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796711296:12345-0@lo:101: Request processed in 112us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509308.215625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788509308.215674:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711296:0@lo:101: 00010000:00010000:3.0:1788509308.215844:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509308.215855:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509308.215932:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711424:0@lo:256: 00000100:00100000:3.0:1788509308.215963:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.215982:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd891b8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788509308.216099:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796711424 00000100:00100000:1.0:1788509308.216104:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796711424 00000100:00100000:1.0:1788509308.216136:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788509308.216148:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796711424:12345-0@lo:256: 20000000:01000000:1.0:1788509308.216161:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788509308.216177:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788509308.216180:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788509308.216267:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796711424:12345-0@lo:256: Request processed in 124us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.216275:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788509308.216307:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711424:0@lo:256: 10000000:01000000:1.0:1788509308.216349:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788509308.216356:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.216365:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509308.216373:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788509308.216375:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788509308.216377:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788509308.216395:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.216402:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.216410:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509308.216432:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711552:0@lo:101: 00000100:00100000:1.0:1788509308.216459:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.216476:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb473e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509308.216488:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796711552 00000100:00100000:1.0:1788509308.216491:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796711552 00000100:00100000:1.0:1788509308.216512:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788509308.216519:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796711552:12345-0@lo:101: 00010000:00010000:1.0:1788509308.216526:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509308.216537:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd6bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.216552:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.216561:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.216569:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9c00, rc 0) 00000100:00100000:1.0:1788509308.216597:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796711552:12345-0@lo:101: Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.217188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788509308.217246:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711552:0@lo:101: 00010000:00010000:1.0:1788509308.217261:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509308.217269:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509308.217338:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711680:0@lo:501: 00000100:00100000:1.0:1788509308.217370:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.217440:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb473e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.220026:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796711680 00000100:00100000:2.0:1788509308.220039:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796711680 00000100:00100000:2.0:1788509308.220230:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788509308.220241:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796711680:12345-0@lo:501: 00000100:00100000:2.0:1788509308.220443:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796711680:12345-0@lo:501: Request processed in 203us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.220462:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788509308.223337:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711680:0@lo:501: 00000100:00100000:0.0:1788509308.223474:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711808:0@lo:503: 00000100:00100000:0.0:1788509308.223559:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.223608:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.223670:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796711808 00000100:00100000:2.0:1788509308.223677:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796711808 00000100:00100000:3.0:1788509308.224067:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788509308.224079:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796711808:12345-0@lo:503: 00000100:00100000:3.0:1788509308.224545:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796711808:12345-0@lo:503: Request processed in 468us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509308.224560:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788509308.224637:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796711808:0@lo:503: 00000100:00100000:3.0:1788509308.225577:0:8753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8753:1875387796711936:0@lo:502: 00000100:00100000:3.0:1788509308.225639:0:8753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.225678:0:8753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.225785:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796711936 00000100:00100000:2.0:1788509308.225792:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796711936 00000100:00100000:2.0:1788509308.225841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788509308.225850:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:8753:x1875387796711936:12345-0@lo:502: 00000100:00100000:2.0:1788509308.225978:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:8753:x1875387796711936:12345-0@lo:502: Request processed in 129us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.225986:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788509308.226095:0:8753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8753:1875387796711936:0@lo:502: 00000020:01000000:3.0:1788509308.226198:0:8753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788509308.226215:0:8753:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788509308.226222:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509308.226224:0:8753:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788509308.226229:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788509308.226233:0:8753:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1788509308.226451:0:8753:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788509308.226456:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788509308.226471:0:8753:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8bcdb47c0000) 00000020:00000080:3.0:1788509308.226574:0:8753:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788509308.226629:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788509308.226737:0:8753:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788509308.226744:0:8753:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788509308.226752:0:8753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dd6d1 00010000:00080000:3.0:1788509308.226795:0:8753:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc8664a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788509308.227027:0:8753:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:0.0:1788509308.239921:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:2.0:1788509308.242635:0:8753:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788509308.242662:0:8753:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788509308.243017:0:8753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788509308.243223:0:8753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788509308.243500:0:8753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788509308.243593:0:8753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788509308.244157:0:8754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788509308.244162:0:8754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788509308.247081:0:8753:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788509308.247098:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788509308.247147:0:8753:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788509308.247174:0:8753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dd6d8 00000100:00080000:2.0:1788509308.247184:0:8753:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788509308.247191:0:8753:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bcc8664a800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509308.247228:0:8753:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc8119c380 x1875387796712064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509308.247277:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796712064:0@lo:8: 00000100:00100000:2.0:1788509308.247362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788509308.247553:0:8753:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788509308.247629:0:8753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509308.247634:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509308.247636:0:8753:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788509308.247639:0:8753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509308.247643:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509308.247645:0:8753:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788509308.247648:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788509308.247650:0:8753:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788509308.247674:0:8753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8753:1875387796712192:0@lo:502: 00000100:00100000:2.0:1788509308.247941:0:8753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509308.247969:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796712192 00000100:00100000:2.0:1788509308.247975:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796712192 00000100:00100000:2.0:1788509308.248018:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788509308.248026:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:8753:x1875387796712192:12345-0@lo:502: 00000100:00100000:2.0:1788509308.248143:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:8753:x1875387796712192:12345-0@lo:502: Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509308.248150:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788509308.248192:0:8753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8667acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509308.248213:0:8753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:8753:1875387796712192:0@lo:502: 00000020:01000000:2.0:1788509308.248235:0:8753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509308.248240:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509308.248252:0:8753:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788509308.248257:0:8753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788509308.249228:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788509308.249254:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788509308.249265:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.249276:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509308.249286:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788509308.249289:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bcd9e5d99c0 from 1 10000000:01000000:0.0:1788509308.249291:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788509308.249319:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.249327:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.249337:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509308.249351:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796712320:0@lo:101: 00000100:00100000:0.0:1788509308.249390:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.249408:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398240 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.249425:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796712320 00000100:00100000:0.0:1788509308.249429:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796712320 00000100:00100000:0.0:1788509308.249471:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788509308.249477:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796712320:12345-0@lo:101: 00010000:00010000:0.0:1788509308.249487:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509308.249498:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd6df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.249517:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd6df expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.249526:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd6df expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.249534:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590ba00, rc 0) 00000100:00100000:0.0:1788509308.249559:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796712320:12345-0@lo:101: Request processed in 82us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.249565:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788509308.249595:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796712320:0@lo:101: 00010000:00010000:0.0:1788509308.249606:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.249614:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509308.249661:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796712448:0@lo:501: 00000100:00100000:0.0:1788509308.249683:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.249696:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398240 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.249708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796712448 00000100:00100000:0.0:1788509308.249711:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796712448 00000100:00100000:0.0:1788509308.249743:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788509308.249757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796712448:12345-0@lo:501: 00000100:00100000:0.0:1788509308.249824:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796712448:12345-0@lo:501: Request processed in 68us (139us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788509308.249830:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788509308.249858:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796712448:0@lo:501: 10000000:01000000:0.0:1788509308.249878:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788509308.249884:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509308.249891:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509308.250350:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1875387796711040:12345-0@lo:700: Request processed in 50700us (51291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.250363:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788509308.250388:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796712064 00000100:00100000:1.0:1788509308.250392:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796712064 00000100:00100000:1.0:1788509308.250410:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788509308.250415:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875387796712064:12345-0@lo:8: 00010000:00080000:1.0:1788509308.250438:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1788509308.250466:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dd6ed 00002000:00100000:1.0:1788509308.250478:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8bcc86311000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788509308.250481:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788509308.250484:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788509308.250543:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788509308.250567:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcc86314800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509308.250606:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875387796712064:12345-0@lo:8: Request processed in 190us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.250612:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788509308.250856:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc865dc000 x1875387796711040/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.250868:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1875387796711040:0@lo:700: 40000000:02000000:0.0:1788509308.250878:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00010000:00080000:2.0:1788509308.251371:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119c380 x1875387796712064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788509318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509308.251392:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788509308.251399:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788509308.251406:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788509308.251421:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788509308.251424:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc8664a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788509308.251445:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788509308.251451:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796712064:0@lo:8: 00000004:00080000:2.0:1788509308.251480:0:8754:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788509308.251519:0:8754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 205412620197ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788509308.251525:0:8754:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788509308.264762:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788509308.264883:0:8755:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788509308.264933:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796712576:0@lo:13: 00000100:00100000:1.0:1788509308.264945:0:8755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875387796712704:0@lo:7: 00000001:00100000:0.0:1788509308.265921:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788509308.265931:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788509308.266104:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.268460:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8751:x1875387796710784:12345-0@lo:700: Request processed in 69518us (71681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.268481:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509308.268531:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796712576 00000100:00100000:0.0:1788509308.268540:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796712576 00000100:00080000:3.0:1788509308.268662:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509308.269718:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509308.269745:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796712576:12345-0@lo:13: 00002000:00000024:0.0:1788509308.269796:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788509308.269872:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796712576:12345-0@lo:13: Request processed in 144us (3770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.269880:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788509308.269945:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913d5500 x1875387796710784/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.269959:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875387796710784:0@lo:700: 00010000:00080000:0.0:1788509308.270224:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e7100 x1875387796712576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.270241:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796712576:0@lo:13: 00000100:00100000:1.0:1788509308.270550:0:8755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.270707:0:8755:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb473ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.272925:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796712704 00000100:00100000:0.0:1788509308.272937:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796712704 00000100:00100000:1.0:1788509308.274355:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509308.274385:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8755:x1875387796712704:12345-0@lo:7: 00000004:00080000:0.0:1788509308.280584:0:8751:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788509308.280628:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875387796712960:0@lo:7: 00000100:00100000:0.0:1788509308.280692:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.280742:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509308.280831:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796712832:0@lo:13: 00000100:00100000:1.0:1788509308.280856:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788509308.280862:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509308.280864:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:1.0:1788509308.281294:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788509308.281300:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788509308.281365:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8755:x1875387796712704:12345-0@lo:7: Request processed in 6982us (10814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.281375:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509308.281414:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796712960 00000100:00100000:1.0:1788509308.281421:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796712960 00000100:00100000:1.0:1788509308.281458:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509308.281466:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8751:x1875387796712960:12345-0@lo:7: 00010000:00080000:3.0:1788509308.281983:0:8755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e6d80 x1875387796712704/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509308.282004:0:8755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875387796712704:0@lo:7: 00000004:00080000:3.0:1788509308.282016:0:8755:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788509308.282045:0:8755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875387796713088:0@lo:5: 00000100:00100000:3.0:1788509308.282077:0:8755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.282095:0:8755:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb473ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509308.282112:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796713088 00000100:00100000:3.0:1788509308.282115:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796713088 00000100:00100000:3.0:1788509308.282136:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509308.282142:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8755:x1875387796713088:12345-0@lo:5: 00002000:00080000:3.0:1788509308.282160:0:8756:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788509308.282164:0:8756:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788509308.282705:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796712832 00000100:00100000:0.0:1788509308.282711:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796712832 00000100:00100000:0.0:1788509308.282753:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509308.282761:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796712832:12345-0@lo:13: 00002000:00000024:0.0:1788509308.282776:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788509308.282836:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796712832:12345-0@lo:13: Request processed in 75us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.282843:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788509308.282880:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913d5500 x1875387796712832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.282936:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796712832:0@lo:13: 00002000:00080000:1.0:1788509308.290227:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788509308.290236:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788509308.290342:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8751:x1875387796712960:12345-0@lo:7: Request processed in 8872us (9645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509308.290353:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788509308.290588:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913d6d80 x1875387796712960/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.290619:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875387796712960:0@lo:7: 00000004:00080000:0.0:1788509308.290634:0:8751:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788509308.290673:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875387796713216:0@lo:5: 00000100:00100000:0.0:1788509308.290706:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.290741:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.290759:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796713216 00000100:00100000:0.0:1788509308.290764:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796713216 00000100:00100000:0.0:1788509308.290799:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509308.290807:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8751:x1875387796713216:12345-0@lo:5: 00002000:00080000:0.0:1788509308.290831:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788509308.290855:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8755:x1875387796713088:12345-0@lo:5: Request processed in 8712us (8777us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788509308.290855:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8751:x1875387796713216:12345-0@lo:5: Request processed in 48us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.290861:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788509308.290889:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913d6d80 x1875387796713216/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.290915:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875387796713216:0@lo:5: 00000004:00080000:0.0:1788509308.290924:0:8751:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788509308.290945:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875387796713344:0@lo:5: 00000100:00100000:0.0:1788509308.290964:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.290975:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509308.291145:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788509308.291174:0:8755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc865dc380 x1875387796713088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509308.291185:0:8755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875387796713088:0@lo:5: 00000004:00080000:3.0:1788509308.291193:0:8755:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788509308.291212:0:8755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875387796713472:0@lo:700: 00000100:00100000:3.0:1788509308.291236:0:8755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509308.291299:0:8755:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb473ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509308.291311:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796713344 00000100:00100000:3.0:1788509308.291314:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796713344 00000100:00100000:3.0:1788509308.291338:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788509308.291344:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8751:x1875387796713344:12345-0@lo:5: 00002000:00080000:3.0:1788509308.291385:0:8756:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788509308.293026:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8751:x1875387796713344:12345-0@lo:5: Request processed in 1677us (2055us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788509308.293035:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509308.296796:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796713472 00000100:00100000:2.0:1788509308.296811:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796713472 00000100:00100000:2.0:1788509308.296941:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509308.296953:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8755:x1875387796713472:12345-0@lo:700: 00010000:00080000:0.0:1788509308.301468:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913d6d80 x1875387796713344/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.301497:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875387796713344:0@lo:5: 00000004:00080000:0.0:1788509308.301513:0:8751:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788509308.301557:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8751:1875387796713600:0@lo:900: 00000100:00100000:0.0:1788509308.306223:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509308.306267:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509308.306310:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796713600 00000100:00100000:0.0:1788509308.306319:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796713600 00000100:00100000:0.0:1788509308.306375:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509308.306385:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8751:x1875387796713600:12345-0@lo:900: 00000100:00100000:0.0:1788509308.306462:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8751:x1875387796713600:12345-0@lo:900: Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.306470:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788509308.306511:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913d5f80 x1875387796713600/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.306526:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8751:1875387796713600:0@lo:900: 00000001:00080000:2.0:1788509308.314085:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1788509308.314101:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1788509308.314437:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8755:x1875387796713472:12345-0@lo:700: Request processed in 17483us (23196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509308.314450:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788509308.314467:0:8755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc865dc000 x1875387796713472/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509308.314479:0:8755:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788509308.314506:0:8755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875387796713472:0@lo:700: 00000004:02000040:0.0:1788509308.316832:0:8755:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788509308.326384:0:8755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875387796713728:0@lo:5: 00000100:00100000:2.0:1788509308.326452:0:8755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509308.326503:0:8755:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8667acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509308.326522:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796713728 00000100:00100000:3.0:1788509308.326531:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796713728 00000100:00100000:3.0:1788509308.326598:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788509308.326609:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8755:x1875387796713728:12345-0@lo:5: 00002000:00080000:3.0:1788509308.337874:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788509308.337895:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788509308.340093:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8755:x1875387796713728:12345-0@lo:5: Request processed in 13479us (13632us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788509308.340105:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788509308.340614:0:8755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119c380 x1875387796713728/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509324 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509308.340631:0:8755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875387796713728:0@lo:5: 00000004:00080000:0.0:1788509308.340645:0:8755:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1788509308.760476:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788509309.094672:0:8812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788509309.782462:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788509309.972201:0:8864:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509309.972710:0:8864:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788509310.807158:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788509310.815331:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1788509311.830382:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509312.726300:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796713856:0@lo:41: 00000100:00100000:1.0:1788509312.726422:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509312.727014:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796713856 00000100:00100000:2.0:1788509312.727026:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796713856 00000100:00100000:2.0:1788509312.727097:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788509312.727109:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796713856:12345-0@lo:41: 00000004:00000024:2.0:1788509312.727156:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788509312.727560:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796713856:12345-0@lo:41: Request processed in 452us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509312.727570:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788509312.727716:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796713856:0@lo:41: 00010000:00010000:1.0:1788509312.858632:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788509312.873376:0:8965:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509312.873788:0:8965:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788509313.239002:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796713984:0@lo:41: 00000100:00100000:0.0:1788509313.239081:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509313.239292:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796713984 00000100:00100000:2.0:1788509313.239300:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796713984 00000100:00100000:2.0:1788509313.239345:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788509313.239354:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796713984:12345-0@lo:41: 00000004:00000024:2.0:1788509313.239388:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788509313.239450:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796713984:12345-0@lo:41: Request processed in 97us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509313.239457:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788509313.239541:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796713984:0@lo:41: 00000100:00100000:3.0:1788509313.750266:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796714240:0@lo:13: 00000100:00100000:3.0:1788509313.750363:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509313.750884:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796714240 00000100:00100000:3.0:1788509313.750894:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796714240 00000100:00100000:3.0:1788509313.750991:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509313.751003:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796714240:12345-0@lo:13: 00000100:00100000:0.0:1788509313.751198:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796714112:0@lo:13: 00000100:00100000:0.0:1788509313.751251:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509313.751293:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788509313.751304:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:1.0:1788509313.751495:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788509313.752312:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509313.752811:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796714368:0@lo:400: 00000100:00100000:0.0:1788509313.754403:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509313.754548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796714880:0@lo:400: 00000100:00100000:0.0:1788509313.754606:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509313.754648:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509313.754656:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796714752:0@lo:400: 00000100:00100000:0.0:1788509313.754769:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509313.754826:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796714752 00000100:00100000:0.0:1788509313.754831:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796714496:0@lo:400: 00000100:00100000:0.0:1788509313.754861:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509313.754879:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796715008:0@lo:400: 00000100:00100000:0.0:1788509313.754935:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509313.755083:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509313.755092:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796714624:0@lo:400: 00000100:00100000:0.0:1788509313.755256:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509313.755287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796714880 00000100:00100000:0.0:1788509313.755295:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796714880 00000100:00100000:2.0:1788509313.755331:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796714752 00000100:00100000:2.0:1788509313.755382:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788509313.755393:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796714752:12345-0@lo:400: 00000100:00100000:2.0:1788509313.755488:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796714752:12345-0@lo:400: Request processed in 96us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509313.755497:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788509313.755526:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796714496 00000100:00100000:2.0:1788509313.755530:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796714496 00000100:00100000:2.0:1788509313.755551:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796715008 00000100:00100000:2.0:1788509313.755554:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796715008 00000100:00100000:2.0:1788509313.755568:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796714624 00000100:00100000:2.0:1788509313.755570:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796714624 00000100:00100000:2.0:1788509313.755585:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509313.755591:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796714496:12345-0@lo:400: 00000100:00100000:2.0:1788509313.755631:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796714496:12345-0@lo:400: Request processed in 39us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509313.755638:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509313.755664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788509313.755670:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796715008:12345-0@lo:400: 00000100:00100000:2.0:1788509313.755714:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796715008:12345-0@lo:400: Request processed in 44us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509313.755721:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788509313.755733:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509313.755739:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796714624:12345-0@lo:400: 00000100:00100000:2.0:1788509313.755770:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796714624:12345-0@lo:400: Request processed in 31us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509313.755772:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788509313.755781:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788509313.755786:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788509313.755810:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788509313.755817:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788509313.755823:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796714880:12345-0@lo:400: 00000100:00100000:1.0:1788509313.755836:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796714368 00000100:00100000:1.0:1788509313.755844:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796714368 00000100:00100000:2.0:1788509313.755871:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796714880:12345-0@lo:400: Request processed in 51us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509313.755879:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788509313.755893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788509313.755926:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3647:x1875387796714368:12345-0@lo:400: 00000100:00100000:1.0:1788509313.755990:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3647:x1875387796714368:12345-0@lo:400: Request processed in 66us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509313.755997:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788509313.756054:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796714112 00000100:00100000:0.0:1788509313.756059:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796714112 00000100:00080000:1.0:1788509313.756061:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509313.756067:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509313.756071:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509313.756467:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796714240:12345-0@lo:13: Request processed in 5463us (6101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509313.756477:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509313.756497:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509313.756510:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796714112:12345-0@lo:13: 00002000:00000024:3.0:1788509313.756540:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509313.756605:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796714112:12345-0@lo:13: Request processed in 86us (5342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509313.756612:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788509313.756786:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc811cea00 x1875387796714112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509313.756801:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788509313.756835:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796714112:0@lo:13: 00010000:00080000:3.0:1788509313.756875:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e4a80 x1875387796714240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509313.756884:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788509313.756917:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796714240:0@lo:13: 00000100:00100000:3.0:1788509313.756989:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796714752:0@lo:400: 00000100:00100000:3.0:1788509313.756999:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796714368:0@lo:400: 00010000:00080000:2.0:1788509313.757238:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e7480 x1875387796714624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509313.757251:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796714624:0@lo:400: 00010000:00080000:2.0:1788509313.757263:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e7b80 x1875387796714496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509313.757272:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796714496:0@lo:400: 00010000:00080000:2.0:1788509313.757291:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e7800 x1875387796715008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509313.757300:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796715008:0@lo:400: 00010000:00080000:3.0:1788509313.759321:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e7100 x1875387796714880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509313.759343:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796714880:0@lo:400: 00000020:00000004:2.0:1788509313.833465:0:9015:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509313.833480:0:9015:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788509313.885845:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509314.902347:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509315.933047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509316.953662:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509317.850064:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796715136:0@lo:41: 00000100:00100000:2.0:1788509317.850165:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509317.850265:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796715136 00000100:00100000:2.0:1788509317.850274:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796715136 00000100:00100000:2.0:1788509317.850342:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788509317.850353:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796715136:12345-0@lo:41: 00000004:00000024:2.0:1788509317.850399:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788509317.850461:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796715136:12345-0@lo:41: Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509317.850469:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788509317.850730:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796715136:0@lo:41: 00010000:00010000:3.0:1788509317.978209:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509318.358207:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796715264:0@lo:41: 00000100:00100000:0.0:1788509318.358300:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509318.358450:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796715264 00000100:00100000:1.0:1788509318.358459:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796715264 00000100:00100000:1.0:1788509318.358520:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788509318.358529:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796715264:12345-0@lo:41: 00000004:00000024:1.0:1788509318.358575:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788509318.361062:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796715264:12345-0@lo:41: Request processed in 2523us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509318.361081:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788509318.361518:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796715264:0@lo:41: 00000100:00100000:2.0:1788509318.871632:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796715520:0@lo:400: 00000100:00100000:2.0:1788509318.871742:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509318.871793:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796716032:0@lo:400: 00000100:00100000:2.0:1788509318.871975:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509318.872008:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788509318.872015:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796715648:0@lo:400: 00000100:00100000:2.0:1788509318.872067:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509318.872086:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796716160:0@lo:400: 00000100:00100000:2.0:1788509318.872107:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509318.872348:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796715520 00000100:00100000:2.0:1788509318.872356:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796715520 00000100:00100000:2.0:1788509318.872403:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796716032 00000100:00100000:2.0:1788509318.872406:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796716032 00000100:00100000:2.0:1788509318.872446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796716160 00000100:00100000:2.0:1788509318.872450:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796716160 00000100:00100000:2.0:1788509318.872465:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788509318.872473:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796715520:12345-0@lo:400: 00000100:00100000:2.0:1788509318.872523:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796715520:12345-0@lo:400: Request processed in 50us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509318.872530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788509318.872546:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509318.872552:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796716032:12345-0@lo:400: 00000100:00100000:2.0:1788509318.872578:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796716032:12345-0@lo:400: Request processed in 26us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509318.872583:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509318.872593:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788509318.872599:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796716160:12345-0@lo:400: 00000100:00100000:2.0:1788509318.872622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796716160:12345-0@lo:400: Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509318.872628:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788509318.872722:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796715648 00000100:00100000:2.0:1788509318.872727:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796715648 00000100:00100000:2.0:1788509318.872756:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788509318.872763:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796715648:12345-0@lo:400: 00000100:00100000:2.0:1788509318.872795:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796715648:12345-0@lo:400: Request processed in 33us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509318.872800:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788509318.872878:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509318.872881:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509318.872926:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796715648:0@lo:400: 00010000:00080000:2.0:1788509318.872951:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119d500 x1875387796716160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509318.872960:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796716160:0@lo:400: 00010000:00080000:2.0:1788509318.872968:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119fb80 x1875387796715520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509318.872976:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796715520:0@lo:400: 00010000:00080000:2.0:1788509318.872984:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119d880 x1875387796716032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509318.872990:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796716032:0@lo:400: 00000100:00100000:0.0:1788509318.873918:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796715776:0@lo:400: 00000100:00100000:0.0:1788509318.873970:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509318.874013:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796716288:0@lo:400: 00000100:00100000:0.0:1788509318.874036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509318.874054:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788509318.874060:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796715392:0@lo:400: 00000100:00100000:0.0:1788509318.874081:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509318.874101:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796715904:0@lo:400: 00000100:00100000:0.0:1788509318.874117:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509318.874128:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796716416:0@lo:400: 00000100:00100000:0.0:1788509318.874142:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509318.874166:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796716288 00000100:00100000:0.0:1788509318.874172:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796716288 00000100:00100000:0.0:1788509318.874202:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796716416 00000100:00100000:0.0:1788509318.874205:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796716416 00000100:00100000:0.0:1788509318.874224:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509318.874231:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796716288:12345-0@lo:400: 00000100:00100000:0.0:1788509318.874271:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796716288:12345-0@lo:400: Request processed in 40us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509318.874278:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509318.874301:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509318.874307:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796716416:12345-0@lo:400: 00000100:00100000:0.0:1788509318.874336:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796716416:12345-0@lo:400: Request processed in 29us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509318.874342:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788509318.874370:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119ca80 x1875387796716416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509318.874382:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796716416:0@lo:400: 00010000:00080000:0.0:1788509318.874393:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119c380 x1875387796716288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509318.874401:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796716288:0@lo:400: 00000100:00100000:2.0:1788509318.874662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796715392 00000100:00100000:2.0:1788509318.874667:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796715392 00000100:00100000:2.0:1788509318.874702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788509318.874709:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3646:x1875387796715392:12345-0@lo:400: 00000100:00100000:2.0:1788509318.874744:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3646:x1875387796715392:12345-0@lo:400: Request processed in 36us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509318.874750:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788509318.874772:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509318.874782:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796715904 00000100:00100000:2.0:1788509318.874784:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796715904 00000100:00100000:2.0:1788509318.874803:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788509318.874808:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796715904:12345-0@lo:400: 00000100:00100000:2.0:1788509318.874833:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796715904:12345-0@lo:400: Request processed in 25us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509318.874839:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788509318.874854:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796715776 00000100:00100000:2.0:1788509318.874863:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796715776 00000100:00100000:2.0:1788509318.874881:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788509318.874886:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796715776:12345-0@lo:400: 00000100:00100000:2.0:1788509318.874937:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796715776:12345-0@lo:400: Request processed in 50us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509318.874943:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788509318.874968:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796715392:0@lo:400: 00000100:00100000:2.0:1788509318.874977:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796715904:0@lo:400: 00010000:00080000:2.0:1788509318.875088:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119dc00 x1875387796715776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509318.875099:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796715776:0@lo:400: 00000100:00100000:3.0:1788509318.876238:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796716544:0@lo:13: 00000100:00100000:3.0:1788509318.876296:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509318.876332:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509318.876338:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796716672:0@lo:13: 00000100:00100000:3.0:1788509318.876360:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509318.876400:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796716544 00000100:00100000:3.0:1788509318.876404:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796716544 00000100:00100000:3.0:1788509318.876435:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796716672 00000100:00100000:3.0:1788509318.876438:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796716672 00000100:00100000:3.0:1788509318.876452:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509318.876460:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796716544:12345-0@lo:13: 00002000:00000024:3.0:1788509318.876484:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509318.876523:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796716544:12345-0@lo:13: Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509318.876529:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509318.876543:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788509318.876549:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796716672:12345-0@lo:13: 00002000:00000024:3.0:1788509318.876559:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509318.876581:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796716672:12345-0@lo:13: Request processed in 33us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509318.876587:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788509318.876615:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc811cd180 x1875387796716672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509318.876630:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796716672:0@lo:13: 00010000:00080000:3.0:1788509318.876641:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc811cc380 x1875387796716544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509318.876651:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796716544:0@lo:13: 00010000:00010000:3.0:1788509318.999340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509320.023335:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509321.050655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509322.070245:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509322.969238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796716800:0@lo:41: 00000100:00100000:0.0:1788509322.969309:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509322.969381:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796716800 00000100:00100000:0.0:1788509322.969389:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796716800 00000100:00100000:0.0:1788509322.969434:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788509322.969443:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796716800:12345-0@lo:41: 00000004:00000024:0.0:1788509322.969474:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788509322.969516:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796716800:12345-0@lo:41: Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509322.969524:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788509322.969744:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796716800:0@lo:41: 00010000:00010000:2.0:1788509323.095791:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788509323.420336:0:9515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788509323.420339:0:9515:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788509323.420341:0:9515:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788509323.420464:0:9515:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bcdb59c5000 00000020:01000004:2.0:1788509323.420478:0:9515:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788509323.420491:0:9515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788509323.420505:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8bcdb46219c0) 00000020:00000080:2.0:1788509323.420520:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788509323.456417:0:9515:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788509323.456467:0:9515:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788509323.468239:0:9515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788509323.468448:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788509323.468509:0:9515:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788509323.468522:0:9515:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe5156b86310dd6fb 00000020:01000004:0.0:1788509323.468528:0:9515:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788509323.468549:0:9515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788509323.468553:0:9515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788509323.468558:0:9515:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788509323.468587:0:9515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788509323.468592:0:9515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:1.0:1788509323.480169:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796716928:0@lo:41: 00000100:00100000:1.0:1788509323.480273:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.480359:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796716928 00000100:00100000:1.0:1788509323.480365:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796716928 00000100:00100000:1.0:1788509323.480410:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788509323.480420:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796716928:12345-0@lo:41: 00000004:00000024:1.0:1788509323.480454:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788509323.480502:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796716928:12345-0@lo:41: Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.480509:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788509323.480571:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796716928:0@lo:41: 00000040:01000000:0.0:1788509323.498759:0:9515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788509323.498799:0:9515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788509323.498804:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788509323.498806:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788509323.498807:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509323.498808:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509323.498810:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509323.498811:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509323.498812:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509323.498814:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788509323.498816:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788509323.498818:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509323.498819:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788509323.498823:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788509323.498825:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788509323.498827:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788509323.498828:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509323.498829:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509323.498830:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509323.498831:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509323.498832:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509323.498833:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788509323.498835:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788509323.498836:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509323.498837:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788509323.498872:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788509323.498891:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796717056:0@lo:253: 00000100:00100000:0.0:1788509323.499057:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.499118:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788509323.499572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796717056 00000100:00100000:1.0:1788509323.499587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796717056 00000100:00100000:1.0:1788509323.499651:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788509323.499660:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:9515:x1875387796717056:12345-0@lo:253: 20000000:01000000:1.0:1788509323.499698:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788509323.499702:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788509323.499707:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788509323.499710:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788509323.500111:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509323.500231:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788509323.500246:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788509323.500263:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788509323.500269:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788509323.500280:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788509323.500293:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788509323.500377:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788509323.500392:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1788509323.500394:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788509323.500409:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788509323.500415:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788509323.500430:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788509323.500435:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788509323.500448:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788509323.500454:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788509323.500465:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788509323.500480:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788509323.500553:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788509323.500564:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1788509323.500566:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788509323.500579:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788509323.500586:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788509323.500598:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788509323.500612:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788509323.500638:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788509323.500645:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788509323.500657:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788509323.500671:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788509323.501315:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788509323.501329:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1788509323.501331:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788509323.501346:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788509323.501352:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788509323.501365:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788509323.501370:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788509323.501382:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788509323.501387:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788509323.501399:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788509323.501416:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788509323.501430:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788509323.501433:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788509323.501436:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788509323.501478:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788509323.501481:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788509323.501810:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788509323.501830:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788509323.501845:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788509323.502532:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788509323.502558:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788509323.502574:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788509323.502584:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788509323.502586:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788509323.503221:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788509323.503381:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788509323.503401:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788509323.503415:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1788509323.503424:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788509323.503425:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788509323.503659:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788509323.503686:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788509323.503709:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788509323.503852:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788509323.503882:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788509323.504323:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1788509323.504340:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788509323.504341:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788509323.504730:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788509323.504747:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788509323.504755:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788509323.505523:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788509323.505551:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788509323.505567:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1788509323.505577:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788509323.505579:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788509323.506154:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788509323.506175:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788509323.506190:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788509323.506337:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788509323.506356:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788509323.506370:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:0.0:1788509323.506385:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788509323.506403:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506419:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506429:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd61b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506436:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd65a expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506443:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd676 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506450:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd699 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506457:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506464:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd6df expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506479:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506516:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd6df expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506530:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd6df expref: 21 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.506545:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717184:0@lo:104: 00000100:00100000:0.0:1788509323.506606:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509323.506671:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506677:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 21 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.506685:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717312:0@lo:104: 00000100:00100000:0.0:1788509323.506707:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509323.506736:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd699 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.506745:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd699 expref: 21 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.506753:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717440:0@lo:104: 00000100:00100000:2.0:1788509323.506860:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796717184 00000100:00100000:2.0:1788509323.506873:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796717184 00000100:00100000:2.0:1788509323.506932:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796717312 00000100:00100000:2.0:1788509323.506935:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796717312 00000100:00100000:2.0:1788509323.506950:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509323.507025:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796717184:12345-0@lo:104: 00010000:00010000:2.0:1788509323.507037:0:7471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507086:0:7471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788509323.507092:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796717184:12345-0@lo:104: Request processed in 135us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.507100:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509323.507117:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788509323.507124:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6513:x1875387796717312:12345-0@lo:104: 00010000:00010000:2.0:1788509323.507131:0:7471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507165:0:7471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788509323.507170:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6513:x1875387796717312:12345-0@lo:104: Request processed in 48us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.507175:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788509323.507191:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788509323.507197:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507204:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509323.507208:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507227:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509323.507234:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509323.507239:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509323.507266:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507273:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509323.507289:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507296:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310dd6df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507328:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509323.507331:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507338:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509323.507341:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507348:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509323.507353:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509323.507367:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509323.507381:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507387:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509323.507392:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507399:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd6bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507409:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.507410:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.507412:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.507418:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509323.507436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796717568:0@lo:103: 00000100:00100000:2.0:1788509323.507466:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.507500:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509323.507505:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.507510:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796717696:0@lo:103: 00000100:00100000:2.0:1788509323.507533:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509323.507585:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd676 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.507600:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd676 expref: 21 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.507610:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717824:0@lo:104: 00000100:00100000:0.0:1788509323.507647:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509323.507664:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd65a expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.507672:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd65a expref: 21 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.507681:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717952:0@lo:104: 00000100:00100000:0.0:1788509323.507703:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.507722:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796717568 00010000:00010000:0.0:1788509323.507726:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd61b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.507728:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796717568 00010000:00010000:2.0:1788509323.507752:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd6df expref: 22 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.507774:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796717696 00000100:00100000:2.0:1788509323.507777:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796717696 00010000:00010000:2.0:1788509323.507787:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 23 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.507808:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd61b expref: 22 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.507819:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796718080:0@lo:104: 00000100:00100000:2.0:1788509323.507822:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509323.507833:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:3644:x1875387796717568:12345-0@lo:103: 00010000:00010000:2.0:1788509323.507845:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788509323.507850:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509323.507854:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd6df expref: 23 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.507868:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd6df expref: 23 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.507880:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.507889:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 23 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.507917:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796718208:0@lo:104: 00000100:00100000:3.0:1788509323.507941:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788509323.507954:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788509323.507978:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717184:0@lo:104: 00000100:00100000:3.0:1788509323.507979:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.507995:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717312:0@lo:104: 00000100:00100000:3.0:1788509323.508009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796717440 00000100:00100000:3.0:1788509323.508013:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796717440 00010000:00010000:2.0:1788509323.508026:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd6e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd6df expref: 23 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509323.508031:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796717824 00000100:00100000:3.0:1788509323.508033:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796717824 00010000:00010000:2.0:1788509323.508040:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509323.508041:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796717952 00000100:00100000:3.0:1788509323.508043:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796717952 00000100:00100000:3.0:1788509323.508050:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796718080 00000100:00100000:3.0:1788509323.508052:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796718080 00000100:00100000:3.0:1788509323.508060:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796718208 00000100:00100000:3.0:1788509323.508063:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796718208 00000100:00100000:2.0:1788509323.508068:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:3644:x1875387796717568:12345-0@lo:103: Request processed in 239us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509323.508073:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509323.508075:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788509323.508078:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+7:6513:x1875387796717440:12345-0@lo:104: 00010000:00010000:3.0:1788509323.508086:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.508087:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788509323.508092:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3644:x1875387796717696:12345-0@lo:103: 00010000:00010000:2.0:1788509323.508099:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509323.508102:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 21 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.508111:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 21 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.508121:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd6bc expref: 21 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.508140:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509323.508162:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:3644:x1875387796717696:12345-0@lo:103: Request processed in 70us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.508169:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788509323.508176:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788509323.508186:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+7:6513:x1875387796717824:12345-0@lo:104: 00000100:00100000:2.0:1788509323.508199:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796717696:0@lo:103: 00010000:00010000:1.0:1788509323.508201:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.508206:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796717568:0@lo:103: 00010000:00010000:3.0:1788509323.508673:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509323.508681:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+7:6513:x1875387796717440:12345-0@lo:104: Request processed in 602us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509323.508687:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788509323.508703:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788509323.508708:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788509323.508709:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:6513:x1875387796717952:12345-0@lo:104: 00010000:00010000:2.0:1788509323.508713:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.508717:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.508719:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8800 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509323.508723:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.508730:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509323.508737:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509323.508743:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509323.508764:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.508770:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509323.508785:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.508802:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.508814:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.508816:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.508819:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509323.508821:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717440:0@lo:104: 00000100:00100000:2.0:1788509323.508833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796718336:0@lo:103: 00000100:00100000:0.0:1788509323.508836:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717824:0@lo:104: 00000100:00100000:2.0:1788509323.508864:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509323.508923:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509323.508930:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:6513:x1875387796717824:12345-0@lo:104: Request processed in 747us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.508936:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788509323.509423:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509323.509429:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509436:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509323.509439:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509447:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509323.509453:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509323.509458:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509323.509484:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509490:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509323.509501:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509519:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a600/0xe5156b86310dd676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd67d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509529:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.509531:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.509533:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509323.509543:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796718464:0@lo:103: 00000100:00100000:2.0:1788509323.509575:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.509607:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796718336 00000100:00100000:2.0:1788509323.509612:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796718336 00010000:00010000:2.0:1788509323.509643:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd699 expref: 20 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.509663:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796718464 00000100:00100000:2.0:1788509323.509666:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796718464 00010000:00010000:2.0:1788509323.509675:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd676 expref: 21 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.509690:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509323.509696:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3646:x1875387796718336:12345-0@lo:103: 00010000:00010000:2.0:1788509323.509705:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509323.509710:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd699 expref: 21 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509719:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd699 expref: 21 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509732:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310dd6a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd699 expref: 21 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509749:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509323.509774:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:3646:x1875387796718336:12345-0@lo:103: Request processed in 77us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.509781:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509323.509795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509323.509800:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3647:x1875387796718464:12345-0@lo:103: 00010000:00010000:2.0:1788509323.509808:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509323.509812:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd676 expref: 19 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509821:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd676 expref: 19 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509830:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590a200/0xe5156b86310dd67d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd676 expref: 19 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.509838:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509323.509861:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3647:x1875387796718464:12345-0@lo:103: Request processed in 61us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.509868:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509323.509942:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796718464:0@lo:103: 00000100:00100000:1.0:1788509323.510027:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788509323.510038:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:6513:x1875387796718080:12345-0@lo:104: 00010000:00010000:1.0:1788509323.510049:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.510093:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509323.510099:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:6513:x1875387796718080:12345-0@lo:104: Request processed in 64us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.510106:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509323.510109:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796718336:0@lo:103: 00000100:00100000:1.0:1788509323.510123:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788509323.510131:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796718208:12345-0@lo:104: 00010000:00010000:2.0:1788509323.510133:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509323.510138:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.510140:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510146:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8a00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509323.510158:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510167:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509323.510173:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509323.510179:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788509323.510184:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509323.510190:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6513:x1875387796718208:12345-0@lo:104: Request processed in 60us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.510197:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788509323.510202:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510210:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509323.510223:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510229:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310dd61b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd622 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510238:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509323.510241:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510246:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9400 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509323.510249:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510256:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509323.510272:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509323.510278:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509323.510290:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510295:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509323.510300:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510306:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dd5f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.510315:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.510327:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.510329:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509323.510340:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796718720:0@lo:103: 00000100:00100000:2.0:1788509323.510364:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.510387:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509323.510392:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796718592:0@lo:103: 00000100:00100000:2.0:1788509323.510410:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.510428:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796718720 00000100:00100000:2.0:1788509323.510432:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796718720 00010000:00010000:2.0:1788509323.510448:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 18 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.510463:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796718592 00000100:00100000:2.0:1788509323.510466:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796718592 00010000:00010000:2.0:1788509323.510483:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd61b expref: 19 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.510495:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788509323.510501:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3645:x1875387796718720:12345-0@lo:103: 00010000:00010000:2.0:1788509323.510508:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509323.510512:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 19 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.511919:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 19 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.511940:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509323.512011:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3645:x1875387796718720:12345-0@lo:103: Request processed in 1508us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.512021:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788509323.512047:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509323.512056:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3645:x1875387796718592:12345-0@lo:103: 00010000:00010000:2.0:1788509323.512068:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509323.512074:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd61b expref: 18 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.512082:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd61b expref: 18 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.512092:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509323.512114:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3645:x1875387796718592:12345-0@lo:103: Request processed in 61us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.512120:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509323.512176:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796718592:0@lo:103: 00000100:00100000:2.0:1788509323.512186:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796718720:0@lo:103: 00010000:00010000:2.0:1788509323.512208:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509323.517660:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509323.517678:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6513:x1875387796717952:12345-0@lo:104: Request processed in 8963us (9968us total) trans 0 rc 0/0 00010000:00010000:2.0:1788509323.517702:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788509323.517709:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788509323.517714:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.517726:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924e00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509323.517731:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.517742:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509323.517750:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509323.517756:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509323.517813:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.517821:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509323.517849:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.517857:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92924e00/0xe5156b86310dd65a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd661 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.517872:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.517875:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.517883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509323.517891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509323.517921:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796718848:0@lo:103: 00000100:00100000:2.0:1788509323.518239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509323.521786:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796718848 00000100:00100000:3.0:1788509323.521799:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796718848 00010000:00010000:3.0:1788509323.521849:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd65a expref: 18 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509323.521911:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788509323.521921:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3647:x1875387796718848:12345-0@lo:103: 00010000:00010000:3.0:1788509323.521934:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509323.521940:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd65a expref: 18 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.521956:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd65a expref: 18 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.521980:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.521990:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.522007:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.522015:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.522023:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.522030:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.522048:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509323.522053:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.522062:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.522071:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.522083:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509323.522158:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3647:x1875387796718848:12345-0@lo:103: Request processed in 237us (3918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509323.522166:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788509323.522188:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796718848:0@lo:103: 00010000:00010000:0.0:1788509323.523344:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dd661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd65a expref: 17 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.523360:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796717952:0@lo:104: 00010000:00010000:0.0:1788509323.523410:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92925600/0xe5156b86310dd622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd61b expref: 16 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.523419:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796718080:0@lo:104: 00010000:00010000:0.0:1788509323.523430:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd5f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd5f1 expref: 15 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.523439:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875387796718208:0@lo:104: 00010000:00010000:0.0:1788509323.523497:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.523508:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.523515:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.523521:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590b000/0xe5156b86310dd702 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788509323.523558:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788509323.526771:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:9515:x1875387796717056:12345-0@lo:253: Request processed in 27104us (27706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.526785:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788509323.527133:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796717056:0@lo:253: 10000000:01000000:2.0:1788509323.527149:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788509323.527153:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788509323.527155:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788509323.527156:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509323.527158:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788509323.527159:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509323.527161:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509323.527162:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788509323.527164:0:9515:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788509323.527165:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509323.527167:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788509323.527188:0:9515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bcdb59c5000 from lustre-OST0001 10000000:01000000:2.0:1788509323.527220:0:9515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788509323.527223:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788509323.527231:0:9515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bcd9e5d99c0 local copy 10000000:01000000:2.0:1788509323.527235:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788509323.527268:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.527279:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.527290:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509323.527308:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796718976:0@lo:101: 00000100:00100000:2.0:1788509323.527354:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.527385:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda63673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509323.527549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796718976 00000100:00100000:3.0:1788509323.527556:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796718976 00000100:00100000:3.0:1788509323.527638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788509323.527648:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+14:9515:x1875387796718976:12345-0@lo:101: 00010000:00010000:3.0:1788509323.527660:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509323.527673:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92924200/0xe5156b86310dd710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd709 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.527696:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924200/0xe5156b86310dd710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd709 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.527706:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92924200/0xe5156b86310dd710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd709 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.527715:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924200, rc 0) 00000100:00100000:3.0:1788509323.527766:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796718976:12345-0@lo:101: Request processed in 119us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509323.527772:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788509323.527831:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796718976:0@lo:101: 00010000:00010000:0.0:1788509323.527845:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.527854:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.527960:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719104:0@lo:501: 00000100:00100000:0.0:1788509323.527986:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.533169:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796719104 00000100:00100000:2.0:1788509323.533183:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796719104 00000100:00100000:2.0:1788509323.533362:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788509323.533376:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719104:12345-0@lo:501: 00000100:00100000:2.0:1788509323.533497:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719104:12345-0@lo:501: Request processed in 124us (5508us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509323.533506:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788509323.535813:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788509323.535854:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719104:0@lo:501: 10000000:01000000:0.0:1788509323.535880:0:9515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788509323.535939:0:9515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788509323.535949:0:9515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.535959:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.535967:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.535986:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788509323.536032:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bcdb59c5000 10000000:01000000:0.0:1788509323.536037:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788509323.536043:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788509323.536046:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788509323.536050:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788509323.536053:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788509323.536087:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.536095:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.536106:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.536126:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719232:0@lo:101: 00000100:00100000:0.0:1788509323.536180:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.536202:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509323.536267:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796719232 00000100:00100000:3.0:1788509323.536275:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796719232 00010000:00010000:2.0:1788509323.536361:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509323.536369:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.536377:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509323.536381:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.536390:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509323.536398:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509323.536404:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509323.536425:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.536432:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509323.536462:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.536481:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226400/0xe5156b86310dd709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe5156b86310dd710 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.536494:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.536496:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509323.536497:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509323.536538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788509323.536546:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719232:12345-0@lo:101: 00010000:00010000:2.0:1788509323.536558:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509323.536571:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd717 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.536594:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd717 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.536604:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd717 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.536613:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226800, rc 0) 00000100:00100000:2.0:1788509323.536661:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796719232:12345-0@lo:101: Request processed in 114us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.536667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788509323.536728:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788509323.536741:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796719360:0@lo:103: 00000100:00100000:0.0:1788509323.536770:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.536812:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719232:0@lo:101: 00010000:00010000:0.0:1788509323.536824:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.536833:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.536894:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719488:0@lo:501: 00000100:00100000:0.0:1788509323.536986:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.537003:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509323.537208:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796719360 00000100:00100000:2.0:1788509323.537213:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796719360 00000100:00100000:2.0:1788509323.537280:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788509323.537288:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3646:x1875387796719360:12345-0@lo:103: 00010000:00010000:2.0:1788509323.537298:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509323.537317:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924200/0xe5156b86310dd710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd709 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.537327:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509323.537361:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:3646:x1875387796719360:12345-0@lo:103: Request processed in 73us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.537367:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509323.537476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796719488 00000100:00100000:1.0:1788509323.537481:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796719488 00000100:00100000:1.0:1788509323.537565:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788509323.537573:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719488:12345-0@lo:501: 00000100:00100000:1.0:1788509323.537692:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719488:12345-0@lo:501: Request processed in 120us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.537698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788509323.538513:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719488:0@lo:501: 00000100:00100000:0.0:1788509323.538561:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719616:0@lo:503: 00000100:00100000:0.0:1788509323.538631:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.538686:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796719360:0@lo:103: 00000100:00100000:0.0:1788509323.544833:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509323.546121:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796719616 00000100:00100000:3.0:1788509323.546133:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796719616 00000100:00100000:3.0:1788509323.546214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788509323.546223:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719616:12345-0@lo:503: 00000100:00100000:3.0:1788509323.546394:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719616:12345-0@lo:503: Request processed in 172us (7773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509323.546402:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788509323.546518:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719616:0@lo:503: 00000040:00080000:0.0:1788509323.546795:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788509323.546875:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719744:0@lo:502: 00000100:00100000:0.0:1788509323.546941:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.546975:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509323.547940:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796719744 00000100:00100000:3.0:1788509323.547948:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796719744 00000100:00100000:3.0:1788509323.547997:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788509323.548005:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719744:12345-0@lo:502: 00000100:00100000:3.0:1788509323.548124:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719744:12345-0@lo:502: Request processed in 119us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509323.548132:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788509323.548232:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719744:0@lo:502: 00000040:00080000:0.0:1788509323.548431:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788509323.548460:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788509323.548491:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788509323.548507:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788509323.548519:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788509323.548532:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788509323.548562:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719872:0@lo:502: 00000100:00100000:0.0:1788509323.548605:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.548654:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509323.549711:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796719872 00000100:00100000:2.0:1788509323.549721:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796719872 00000100:00100000:2.0:1788509323.549773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788509323.549782:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719872:12345-0@lo:502: 00000100:00100000:2.0:1788509323.549929:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796719872:12345-0@lo:502: Request processed in 147us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.549937:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788509323.550041:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796719872:0@lo:502: 00000040:00080000:0.0:1788509323.550107:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788509323.550118:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788509323.550652:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788509323.550660:0:9526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788509323.550667:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509323.550669:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788509323.550675:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788509323.550701:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8bcc870f3380) 00000020:00000080:3.0:1788509323.550725:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788509323.550732:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788509323.550808:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcdb59c5000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788509323.550816:0:9526:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788509323.550829:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe5156b86310dd72c 00010000:00010000:2.0:1788509323.559128:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788509323.559394:0:9526:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788509323.561942:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788509323.562295:0:9526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788509323.566306:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788509323.566470:0:9526:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788509323.572340:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788509323.573989:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788509323.574001:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509323.574007:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509323.574009:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788509323.574013:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509323.574017:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509323.574018:0:9526:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788509323.574027:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788509323.574029:0:9526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788509323.574051:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509323.574055:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509323.574056:0:9526:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788509323.574059:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788509323.574200:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788509323.574228:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788509323.574258:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.574271:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509323.574279:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdb59c5000 from 1 10000000:01000000:0.0:1788509323.574282:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509323.574318:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.574327:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.574337:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.574360:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720000:0@lo:101: 00000100:00100000:0.0:1788509323.574426:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.574467:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509323.574643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796720000 00000100:00100000:2.0:1788509323.574651:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796720000 00000100:00100000:2.0:1788509323.574701:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788509323.574711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796720000:12345-0@lo:101: 00010000:00010000:2.0:1788509323.574724:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509323.574737:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd733 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.574760:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd733 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.574771:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd733 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.574780:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226400, rc 0) 00000100:00100000:2.0:1788509323.574829:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720000:12345-0@lo:101: Request processed in 120us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.574836:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788509323.574938:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720000:0@lo:101: 00010000:00010000:1.0:1788509323.574953:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.574971:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509323.575056:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720128:0@lo:501: 00000100:00100000:1.0:1788509323.575086:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.575116:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb1090f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509323.575232:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796720128 00000100:00100000:2.0:1788509323.575237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796720128 00000100:00100000:2.0:1788509323.575267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788509323.575273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720128:12345-0@lo:501: 00000100:00100000:2.0:1788509323.575365:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720128:12345-0@lo:501: Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.575386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788509323.575502:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720128:0@lo:501: 00000100:00100000:1.0:1788509323.575529:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720256:0@lo:503: 00000100:00100000:1.0:1788509323.575567:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.575596:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb1090f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509323.575650:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796720256 00000100:00100000:2.0:1788509323.575654:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796720256 00000100:00100000:2.0:1788509323.575709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788509323.575717:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720256:12345-0@lo:503: 00000100:00100000:2.0:1788509323.575801:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720256:12345-0@lo:503: Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.575808:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788509323.575869:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720256:0@lo:503: 00000040:00080000:0.0:1788509323.576146:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788509323.576201:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720384:0@lo:502: 00000100:00100000:0.0:1788509323.576235:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.580015:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788509323.580120:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796720384 00000100:00100000:1.0:1788509323.580130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796720384 00000100:00100000:1.0:1788509323.580370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788509323.580381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720384:12345-0@lo:502: 00000100:00100000:1.0:1788509323.580544:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720384:12345-0@lo:502: Request processed in 165us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.580552:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788509323.580985:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720384:0@lo:502: 00000040:00080000:3.0:1788509323.581255:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788509323.581290:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788509323.581326:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720512:0@lo:502: 00000100:00100000:3.0:1788509323.581374:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509323.581396:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788509323.581773:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796720512 00000100:00100000:1.0:1788509323.581780:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796720512 00000100:00100000:1.0:1788509323.581812:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788509323.581821:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720512:12345-0@lo:502: 00000100:00100000:1.0:1788509323.581940:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720512:12345-0@lo:502: Request processed in 120us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.581948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788509323.582292:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720512:0@lo:502: 00000040:00080000:1.0:1788509323.582357:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788509323.582368:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788509323.586253:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509323.586266:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509323.586269:0:9530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788509323.586278:0:9530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcdb59c5000 00000020:00000080:2.0:1788509323.586280:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788509323.586293:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509323.586296:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509323.586297:0:9530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788509323.586301:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788509323.586436:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788509323.586465:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788509323.586488:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.586500:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509323.586550:0:9515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788509323.586554:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bcdb59c5000 10000000:01000000:3.0:1788509323.586557:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bcdb59c5000 10000000:01000000:3.0:1788509323.586561:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788509323.586566:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcdb59c5000 from 1 10000000:01000000:3.0:1788509323.586569:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509323.586603:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.586612:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.586632:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509323.586654:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720640:0@lo:101: 00000100:00100000:3.0:1788509323.586731:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509323.587070:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509323.587190:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796720640 00000100:00100000:0.0:1788509323.587197:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796720640 00000100:00100000:0.0:1788509323.587249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788509323.587258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:9515:x1875387796720640:12345-0@lo:101: 00010000:00010000:0.0:1788509323.587282:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509323.587297:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd741 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.587322:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd741 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.587334:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd741 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.587343:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a400, rc 0) 00000100:00100000:0.0:1788509323.587393:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796720640:12345-0@lo:101: Request processed in 136us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.587400:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788509323.587512:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720640:0@lo:101: 00010000:00010000:3.0:1788509323.587527:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509323.587536:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509323.587657:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720768:0@lo:501: 00000100:00100000:3.0:1788509323.587687:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509323.587718:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509323.587757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796720768 00000100:00100000:2.0:1788509323.587763:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796720768 00000100:00100000:2.0:1788509323.587797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788509323.587804:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796720768:12345-0@lo:501: 00000100:00100000:2.0:1788509323.587928:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796720768:12345-0@lo:501: Request processed in 124us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.587935:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788509323.588077:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720768:0@lo:501: 00000100:00100000:3.0:1788509323.588113:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720896:0@lo:503: 00000100:00100000:3.0:1788509323.588153:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509323.588178:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509323.588215:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796720896 00000100:00100000:2.0:1788509323.588219:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796720896 00000100:00100000:2.0:1788509323.588250:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788509323.588257:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796720896:12345-0@lo:503: 00000100:00100000:2.0:1788509323.588338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796720896:12345-0@lo:503: Request processed in 81us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.588345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788509323.588412:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796720896:0@lo:503: 00000040:00080000:3.0:1788509323.588647:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788509323.588713:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796721024:0@lo:502: 00000100:00100000:3.0:1788509323.588751:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509323.588775:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509323.588791:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796721024 00000100:00100000:3.0:1788509323.588795:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796721024 00000100:00100000:3.0:1788509323.588814:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788509323.588820:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796721024:12345-0@lo:502: 00000100:00100000:3.0:1788509323.588922:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796721024:12345-0@lo:502: Request processed in 77us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509323.588936:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788509323.589045:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796721024:0@lo:502: 00000040:00080000:3.0:1788509323.589222:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788509323.589248:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788509323.589262:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788509323.589290:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788509323.589308:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788509323.589323:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788509323.589336:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788509323.589350:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788509323.589362:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788509323.589376:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788509323.589389:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788509323.589403:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788509323.589417:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788509323.589430:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788509323.589442:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788509323.589457:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788509323.589470:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788509323.589483:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788509323.589497:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788509323.589522:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788509323.589539:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788509323.589554:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788509323.589568:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788509323.589582:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788509323.589595:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788509323.589607:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788509323.589630:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788509323.589646:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788509323.589661:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788509323.589686:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788509323.589700:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788509323.589713:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788509323.589726:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788509323.589738:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788509323.589751:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788509323.589778:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788509323.589794:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788509323.589807:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788509323.589819:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788509323.589830:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788509323.589843:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788509323.589857:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788509323.589870:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788509323.589884:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788509323.589921:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788509323.589939:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788509323.590203:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796721152:0@lo:502: 00000100:00100000:3.0:1788509323.590258:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509323.590326:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509323.590352:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796721152 00000100:00100000:3.0:1788509323.590359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796721152 00000100:00100000:0.0:1788509323.590483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788509323.590495:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796721152:12345-0@lo:502: 00000100:00100000:0.0:1788509323.590605:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796721152:12345-0@lo:502: Request processed in 112us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.590612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788509323.590715:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796721152:0@lo:502: 00000040:00080000:2.0:1788509323.590768:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788509323.590777:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788509323.591533:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788509323.591549:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8bcdbbec99c0) 00000020:00000080:0.0:1788509323.591571:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788509323.591677:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcdb59c5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788509323.591681:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcdb59c5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788509323.591683:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcdb59c5000 3 00010000:00080000:0.0:1788509323.591713:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc87392800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788509323.593991:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788509323.594187:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788509323.594239:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788509323.594253:0:9531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe5156b86310dd756 00000100:00080000:0.0:1788509323.594263:0:9531:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788509323.594269:0:9531:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bcc87392800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509323.594303:0:9531:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc870b5180 x1875387796721280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509323.594346:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796721280:0@lo:38: 00000100:00100000:0.0:1788509323.594409:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.594470:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796721280 00000100:00100000:0.0:1788509323.594477:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796721280 00000100:00100000:0.0:1788509323.594508:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509323.594515:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875387796721280:12345-0@lo:38: 00010000:00080000:0.0:1788509323.594536:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:0.0:1788509323.594575:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe5156b86310dd75d 00000004:00100000:0.0:1788509323.594590:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788509323.594618:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8bcc87395800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788509323.598033:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788509323.598321:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796721536:0@lo:400: 00000100:00100000:1.0:1788509323.598377:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.598410:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796722048:0@lo:400: 00000100:00100000:1.0:1788509323.598464:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.598486:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788509323.598491:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796721408:0@lo:400: 00000100:00100000:1.0:1788509323.598519:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.598535:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796721920:0@lo:400: 00000100:00100000:1.0:1788509323.598556:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.598587:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796721664:0@lo:400: 00000100:00100000:1.0:1788509323.598612:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.598635:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509323.598640:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796721792:0@lo:400: 00000100:00100000:1.0:1788509323.598666:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.598691:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796721536 00000100:00100000:1.0:1788509323.598698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796721536 00000100:00100000:1.0:1788509323.598735:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796721408 00000100:00100000:1.0:1788509323.598738:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796721408 00000100:00100000:1.0:1788509323.598749:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796721664 00000100:00100000:1.0:1788509323.598751:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796721664 00000100:00100000:1.0:1788509323.598774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796721792 00000100:00100000:1.0:1788509323.598777:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796721792 00000100:00100000:1.0:1788509323.598793:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788509323.598800:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796721536:12345-0@lo:400: 00000100:00100000:1.0:1788509323.598852:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796721536:12345-0@lo:400: Request processed in 51us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.598859:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788509323.598888:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788509323.598894:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796721408:12345-0@lo:400: 00000100:00100000:1.0:1788509323.598946:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796721408:12345-0@lo:400: Request processed in 52us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.598952:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788509323.599194:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788509323.599203:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796721664:12345-0@lo:400: 00000100:00100000:0.0:1788509323.599244:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796721664:12345-0@lo:400: Request processed in 42us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.599251:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788509323.599268:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788509323.599275:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796721792:12345-0@lo:400: 00000100:00100000:0.0:1788509323.599304:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796721792:12345-0@lo:400: Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.599309:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788509323.599339:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796722048 00000100:00100000:0.0:1788509323.599343:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796722048 00000100:00100000:0.0:1788509323.599366:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796721920 00000100:00100000:0.0:1788509323.599370:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796721920 00000100:00100000:0.0:1788509323.599389:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509323.599394:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796722048:12345-0@lo:400: 00000100:00100000:0.0:1788509323.599424:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796722048:12345-0@lo:400: Request processed in 30us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.599429:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509323.599441:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788509323.599446:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796721920:12345-0@lo:400: 00000100:00100000:0.0:1788509323.599469:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796721920:12345-0@lo:400: Request processed in 24us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.599475:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788509323.599508:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e7b80 x1875387796721792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509323.599521:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796721792:0@lo:400: 00010000:00080000:0.0:1788509323.599533:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e7800 x1875387796721664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509323.599542:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796721664:0@lo:400: 00000100:00100000:0.0:1788509323.599588:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875387796721280:12345-0@lo:38: Request processed in 5073us (5179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.599595:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788509323.599631:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc870b5180 x1875387796721280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509323.599641:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509323.599654:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788509323.599661:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788509323.599665:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788509323.599668:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc87392800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788509323.599674:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796721280:0@lo:38: 00000100:00080000:1.0:1788509323.599753:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509323.599757:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509323.599759:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788509323.599779:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e6680 x1875387796721408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509323.599789:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796721408:0@lo:400: 00010000:00080000:1.0:1788509323.599809:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e7480 x1875387796721920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509323.599818:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796721920:0@lo:400: 00010000:00080000:1.0:1788509323.599829:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e6d80 x1875387796721536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509323.599837:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796721536:0@lo:400: 00010000:00080000:1.0:1788509323.599847:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e4a80 x1875387796722048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509323.599855:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796722048:0@lo:400: 00000020:01000004:0.0:1788509323.600638:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788509323.600666:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8bcc874e19c0) 00000020:00000080:0.0:1788509323.600689:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788509323.600771:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcdb59c5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788509323.600776:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcdb59c5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788509323.600779:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcdb59c5000 3 00010000:00080000:0.0:1788509323.600809:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc87393800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788509323.602539:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:3.0:1788509323.603126:0:9533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1875387796722176:0@lo:901: 00000100:00100000:3.0:1788509323.603194:0:9533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509323.603231:0:9533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509323.603279:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796722176 00000100:00100000:1.0:1788509323.603287:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796722176 00000100:00100000:1.0:1788509323.603352:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509323.603363:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1875387796722176:12345-0@lo:901: 00000100:00100000:1.0:1788509323.603466:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1875387796722176:12345-0@lo:901: Request processed in 104us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.603474:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788509323.603508:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788509323.603539:0:9533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc865dea00 x1875387796722176/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788509339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509323.603554:0:9533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1875387796722176:0@lo:901: 00000020:00000080:0.0:1788509323.611361:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788509323.611410:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788509323.611423:0:9531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe5156b86310dd76b 00000100:00080000:0.0:1788509323.611435:0:9531:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788509323.611441:0:9531:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8bcc87393800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509323.611478:0:9531:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc870b5180 x1875387796722304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509323.611508:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875387796722304:0@lo:38: 00000100:00100000:0.0:1788509323.611575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788509323.611639:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788509323.613688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796722304 00000100:00100000:2.0:1788509323.613701:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796722304 00000100:00100000:2.0:1788509323.613748:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509323.613756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796722304:12345-0@lo:38: 00010000:00080000:2.0:1788509323.613787:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1788509323.613828:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe5156b86310dd772 00000004:00100000:2.0:1788509323.613845:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788509323.613878:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8bcc86041800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509323.614057:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875387796722304:12345-0@lo:38: Request processed in 299us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.614065:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788509323.614198:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc870b5180 x1875387796722304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509323.614210:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509323.614218:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788509323.614234:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788509323.614239:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788509323.614242:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc87393800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788509323.614248:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875387796722304:0@lo:38: 00000040:00080000:0.0:1788509323.614679:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788509323.614854:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788509323.614894:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788509323.615048:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509323.615060:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788509323.615114:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788509323.615116:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788509323.615122:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509323.615123:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509323.615124:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509323.615125:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509323.615127:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788509323.615128:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788509323.615129:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788509323.615131:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509323.615132:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788509323.615136:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788509323.615138:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788509323.615139:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788509323.615140:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509323.615141:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509323.615142:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509323.615143:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509323.615144:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788509323.615144:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788509323.615145:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788509323.615146:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509323.615147:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788509323.615168:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788509323.615184:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796722432:0@lo:253: 00000100:00100000:2.0:1788509323.615235:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.615263:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788509323.615358:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796722432 00000100:00100000:0.0:1788509323.615364:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796722432 00000100:00100000:0.0:1788509323.615409:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788509323.615418:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:9515:x1875387796722432:12345-0@lo:253: 20000000:01000000:0.0:1788509323.615441:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788509323.615454:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788509323.628563:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788509323.628580:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788509323.628772:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788509323.628777:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788509323.628802:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.628822:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd668 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.628830:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.628837:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.628874:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.628889:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 17 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.629010:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796722560:0@lo:104: 00000100:00100000:0.0:1788509323.629084:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509323.629133:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd668 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.629142:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd668 expref: 17 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.629152:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796722688:0@lo:104: 00000100:00100000:0.0:1788509323.629175:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.629193:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9820af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788509323.629411:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796722560 00000100:00100000:1.0:1788509323.629419:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796722560 00000100:00100000:1.0:1788509323.629683:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796722688 00000100:00100000:1.0:1788509323.629688:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796722688 00000100:00100000:1.0:1788509323.629708:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788509323.629725:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6536:x1875387796722560:12345-0@lo:104: 00010000:00010000:1.0:1788509323.629738:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.629816:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509323.629823:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:6536:x1875387796722560:12345-0@lo:104: Request processed in 100us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.629830:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788509323.629859:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788509323.629866:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6536:x1875387796722688:12345-0@lo:104: 00010000:00010000:1.0:1788509323.629875:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.629933:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788509323.629939:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:6536:x1875387796722688:12345-0@lo:104: Request processed in 74us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.629945:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788509323.629970:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509323.629975:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.629983:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509323.629987:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.629996:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509323.630004:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509323.630017:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788509323.630046:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630053:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509323.630068:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630075:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd6ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd6b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630086:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509323.630089:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630094:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227e00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509323.630097:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630104:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509323.630110:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509323.630116:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788509323.630129:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630135:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509323.630147:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630153:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227e00/0xe5156b86310dd668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630166:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509323.630168:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509323.630170:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509323.630177:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509323.630187:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796722944:0@lo:103: 00000100:00100000:1.0:1788509323.630219:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.630246:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509323.630252:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796722816:0@lo:103: 00000100:00100000:1.0:1788509323.630272:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509323.630300:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796722944 00000100:00100000:1.0:1788509323.630305:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796722944 00010000:00010000:1.0:1788509323.630323:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd668 expref: 18 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509323.630342:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796722816 00000100:00100000:1.0:1788509323.630346:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796722816 00010000:00010000:1.0:1788509323.630357:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 19 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509323.630377:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788509323.630384:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3647:x1875387796722944:12345-0@lo:103: 00010000:00010000:1.0:1788509323.630395:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509323.630400:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd668 expref: 19 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630420:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd668 expref: 19 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630436:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509323.630467:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3647:x1875387796722944:12345-0@lo:103: Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.630474:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788509323.630491:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788509323.630498:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3647:x1875387796722816:12345-0@lo:103: 00010000:00010000:1.0:1788509323.630505:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509323.630510:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 18 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630519:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 18 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630530:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630538:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788509323.630551:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015788200s 00010000:00010000:1.0:1788509323.630556:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630562:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630569:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630581:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630587:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509323.630591:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630598:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630607:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509323.630617:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509323.630654:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:3647:x1875387796722816:12345-0@lo:103: Request processed in 157us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509323.630661:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788509323.630808:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924600/0xe5156b86310dd6b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd6ae expref: 17 pid: 6514 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.630819:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796722560:0@lo:104: 00010000:00010000:0.0:1788509323.630830:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590b400/0xe5156b86310dd66f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd668 expref: 16 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.630838:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875387796722688:0@lo:104: 00010000:00010000:0.0:1788509323.630855:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.630864:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.630870:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509323.630888:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd779 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509323.631203:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:9515:x1875387796722432:12345-0@lo:253: Request processed in 15785us (15966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.631212:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788509323.631340:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:9515:1875387796722432:0@lo:253: 10000000:01000000:2.0:1788509323.631350:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788509323.631354:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788509323.631356:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788509323.631357:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509323.631358:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509323.631360:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509323.631361:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509323.631363:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788509323.631365:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788509323.631366:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788509323.631374:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509323.631376:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788509323.631386:0:9515:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788509323.632156:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796722816:0@lo:103: 00000100:00100000:0.0:1788509323.632168:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796722944:0@lo:103: 00080000:10000000:2.0:1788509323.640679:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788509323.640852:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788509323.641101:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788509323.641260:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788509323.641467:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788509323.641722:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788509323.651111:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788509323.675034:0:9515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788509323.675044:0:9515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788509323.675092:0:9515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788509323.675139:0:9515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788509323.675157:0:9515:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788509323.675188:0:9515:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788509323.676031:0:9515:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509323.676231:0:9515:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1788509323.991799:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509323.991824:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796723072:0@lo:13: 00000100:00100000:1.0:1788509323.991947:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509323.992126:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796723072 00000100:00100000:2.0:1788509323.992135:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796723072 00000100:00100000:2.0:1788509323.992187:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509323.992196:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796723072:12345-0@lo:13: 00002000:00000024:2.0:1788509323.992226:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509323.992270:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796723072:12345-0@lo:13: Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509323.992277:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788509323.992319:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc8119ca80 x1875387796723072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509323.992336:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796723072:0@lo:13: 00000100:00100000:2.0:1788509323.993165:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796723200:0@lo:13: 00000100:00100000:2.0:1788509323.993224:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509323.993318:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796723200 00000100:00100000:0.0:1788509323.993324:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796723200 00000100:00100000:0.0:1788509323.993361:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509323.993369:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796723200:12345-0@lo:13: 00002000:00000024:0.0:1788509323.993382:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509323.993429:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796723200:12345-0@lo:13: Request processed in 60us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509323.993435:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788509323.993543:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc870b7100 x1875387796723200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509323.993557:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796723200:0@lo:13: 00010000:00010000:1.0:1788509324.118233:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788509324.502361:0:9587:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509324.502596:0:9587:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788509325.143169:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509326.166155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509327.190166:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509328.086271:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509328.086295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796723328:0@lo:41: 00000100:00100000:2.0:1788509328.086397:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509328.086503:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796723328 00000100:00100000:1.0:1788509328.086511:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796723328 00000100:00100000:1.0:1788509328.086561:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788509328.086570:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796723328:12345-0@lo:41: 00000004:00000024:1.0:1788509328.086611:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788509328.086685:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796723328:12345-0@lo:41: Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509328.086692:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788509328.086748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796723328:0@lo:41: 00010000:00010000:1.0:1788509328.214175:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509328.598130:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796723456:0@lo:41: 00000100:00100000:1.0:1788509328.598240:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509328.598328:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796723456 00000100:00100000:1.0:1788509328.598335:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796723456 00000100:00100000:1.0:1788509328.598392:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788509328.598402:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796723456:12345-0@lo:41: 00000004:00000024:1.0:1788509328.598449:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788509328.598496:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796723456:12345-0@lo:41: Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509328.598502:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788509328.598556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796723456:0@lo:41: 00000001:02000400:0.0:1788509329.087976:0:9876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788509329.110232:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509329.110257:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796723584:0@lo:13: 00000100:00100000:2.0:1788509329.110361:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.110427:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796723584 00000100:00100000:2.0:1788509329.110433:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796723584 00000100:00100000:2.0:1788509329.110501:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788509329.110511:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796723584:12345-0@lo:13: 00002000:00000024:2.0:1788509329.110538:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509329.110594:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796723584:12345-0@lo:13: Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.110602:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788509329.110623:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788509329.110651:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119d500 x1875387796723584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509329.110668:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796723584:0@lo:13: 00000100:00100000:1.0:1788509329.111148:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796723712:0@lo:13: 00000100:00100000:1.0:1788509329.111182:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.116789:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796723712 00000100:00100000:2.0:1788509329.116801:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796723712 00000100:00100000:2.0:1788509329.116850:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788509329.116860:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796723712:12345-0@lo:13: 00002000:00000024:2.0:1788509329.116880:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509329.116966:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796723712:12345-0@lo:13: Request processed in 107us (5782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.116973:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788509329.116999:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796723840:0@lo:400: 00000100:00100000:2.0:1788509329.117036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.117064:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796724352:0@lo:400: 00000100:00100000:2.0:1788509329.117086:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.117103:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796724864:0@lo:400: 00000100:00100000:2.0:1788509329.117130:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.117158:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788509329.117164:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796723968:0@lo:400: 00000100:00100000:2.0:1788509329.117182:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.117197:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796724480:0@lo:400: 00000100:00100000:2.0:1788509329.117212:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.117235:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796723840 00000100:00100000:2.0:1788509329.117239:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796723840 00000100:00100000:2.0:1788509329.117262:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788509329.117268:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:3646:x1875387796723840:12345-0@lo:400: 00000100:00100000:2.0:1788509329.117297:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:3646:x1875387796723840:12345-0@lo:400: Request processed in 29us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.117303:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788509329.117327:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796724352 00000100:00100000:2.0:1788509329.117330:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796724352 00000100:00100000:2.0:1788509329.117350:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788509329.117355:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796724352:12345-0@lo:400: 00000100:00100000:2.0:1788509329.117381:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796724352:12345-0@lo:400: Request processed in 26us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.117387:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788509329.117403:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796724864 00000100:00100000:2.0:1788509329.117407:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796724864 00000100:00100000:2.0:1788509329.117431:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796723968 00000100:00100000:2.0:1788509329.117434:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796723968 00000100:00100000:2.0:1788509329.117444:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796724480 00000100:00100000:2.0:1788509329.117447:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796724480 00000100:00100000:2.0:1788509329.117460:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788509329.117465:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796724864:12345-0@lo:400: 00000100:00100000:2.0:1788509329.117494:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796724864:12345-0@lo:400: Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.117507:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788509329.117520:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788509329.117526:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796723968:12345-0@lo:400: 00000100:00100000:2.0:1788509329.117554:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796723968:12345-0@lo:400: Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.117560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788509329.117570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509329.117575:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796724480:12345-0@lo:400: 00000100:00100000:2.0:1788509329.117614:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796724480:12345-0@lo:400: Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.117620:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788509329.117648:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509329.117652:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509329.117654:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788509329.117683:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119d880 x1875387796723968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509329.117697:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796723968:0@lo:400: 00010000:00080000:2.0:1788509329.117708:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd891f8e00 x1875387796724480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509329.117715:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796724480:0@lo:400: 00000100:00100000:2.0:1788509329.117723:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796723840:0@lo:400: 00000100:00100000:2.0:1788509329.117731:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796724352:0@lo:400: 00010000:00080000:2.0:1788509329.117738:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781180 x1875387796724864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509329.117756:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796724864:0@lo:400: 00000100:00100000:2.0:1788509329.117783:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796724224:0@lo:400: 00000100:00100000:2.0:1788509329.117809:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.117826:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796724736:0@lo:400: 00000100:00100000:2.0:1788509329.117851:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788509329.117873:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc870b5180 x1875387796723712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509329.117886:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796723712:0@lo:13: 00000100:00100000:2.0:1788509329.117921:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788509329.117928:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796724096:0@lo:400: 00000100:00100000:2.0:1788509329.117952:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.117969:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796724608:0@lo:400: 00000100:00100000:2.0:1788509329.117987:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509329.118010:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796724224 00000100:00100000:2.0:1788509329.118014:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796724224 00000100:00100000:2.0:1788509329.118031:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796724736 00000100:00100000:2.0:1788509329.118033:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796724736 00000100:00100000:2.0:1788509329.118051:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796724608 00000100:00100000:2.0:1788509329.118054:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796724608 00000100:00100000:2.0:1788509329.118067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788509329.118073:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796724224:12345-0@lo:400: 00000100:00100000:2.0:1788509329.118108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796724224:12345-0@lo:400: Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.118114:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788509329.118125:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788509329.118139:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796724736:12345-0@lo:400: 00000100:00100000:2.0:1788509329.118168:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796724736:12345-0@lo:400: Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.118174:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788509329.118185:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788509329.118191:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796724608:12345-0@lo:400: 00000100:00100000:2.0:1788509329.118216:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796724608:12345-0@lo:400: Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.118222:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788509329.118238:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509329.118241:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509329.118248:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796724096 00000100:00100000:2.0:1788509329.118252:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796724096 00000100:00100000:2.0:1788509329.118272:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788509329.118278:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796724096:12345-0@lo:400: 00000100:00100000:2.0:1788509329.118307:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796724096:12345-0@lo:400: Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509329.118312:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788509329.118339:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796724096:0@lo:400: 00010000:00080000:2.0:1788509329.118349:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd891f8a80 x1875387796724608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509329.118358:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796724608:0@lo:400: 00010000:00080000:2.0:1788509329.118366:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd891f9c00 x1875387796724224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509329.118373:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796724224:0@lo:400: 00010000:00080000:2.0:1788509329.118393:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87780380 x1875387796724736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509329.118401:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796724736:0@lo:400: 00010000:00010000:1.0:1788509329.241394:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788509329.985777:0:9929:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509329.988315:0:9929:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788509330.263509:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509331.286098:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509332.313682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788509332.708277:0:10030:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509332.711226:0:10030:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788509333.206753:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788509333.206760:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd913e8000 from 39 10000000:01000000:3.0:1788509333.206765:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509333.206807:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.206836:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.206848:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.206870:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796724992:0@lo:101: 00000100:00100000:3.0:1788509333.206959:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.207005:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.207657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796724992 00000100:00100000:1.0:1788509333.207672:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796724992 00000100:00100000:1.0:1788509333.207728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788509333.207736:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796724992:12345-0@lo:101: 00010000:00010000:1.0:1788509333.207749:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509333.207761:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd780 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.207784:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd780 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.207793:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd780 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.207801:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9800, rc 0) 00000100:00100000:1.0:1788509333.207854:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796724992:12345-0@lo:101: Request processed in 119us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.207860:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788509333.207994:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796725120:0@lo:41: 00000100:00100000:3.0:1788509333.208029:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.208068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796725120 00000100:00100000:3.0:1788509333.208072:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796725120 00000100:00100000:3.0:1788509333.208099:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788509333.208106:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796725120:12345-0@lo:41: 00000004:00000024:3.0:1788509333.208131:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788509333.208207:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796725120:12345-0@lo:41: Request processed in 101us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.208213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788509333.208686:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796725120:0@lo:41: 00000100:00100000:3.0:1788509333.215374:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796724992:0@lo:101: 00010000:00010000:3.0:1788509333.215404:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.215416:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.215518:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796725248:0@lo:501: 00000100:00100000:3.0:1788509333.216061:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.216154:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea780 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.222368:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796725248 00000100:00100000:2.0:1788509333.222382:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796725248 00000100:00100000:3.0:1788509333.222506:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788509333.222517:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796725248:12345-0@lo:501: 00000100:00100000:3.0:1788509333.222729:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796725248:12345-0@lo:501: Request processed in 214us (6668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.222737:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788509333.222945:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796725248:0@lo:501: 00000100:00100000:1.0:1788509333.222993:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796725376:0@lo:503: 00000100:00100000:1.0:1788509333.223048:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.223086:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.223212:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796725376 00000100:00100000:3.0:1788509333.223217:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796725376 00000100:00100000:3.0:1788509333.223257:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788509333.223264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796725376:12345-0@lo:503: 00000100:00100000:3.0:1788509333.223341:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796725376:12345-0@lo:503: Request processed in 77us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.223347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788509333.223482:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796725376:0@lo:503: 00000100:00100000:1.0:1788509333.223938:0:10050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10050:1875387796725504:0@lo:502: 00000100:00100000:1.0:1788509333.223975:0:10050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.224000:0:10050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.224139:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796725504 00000100:00100000:3.0:1788509333.224144:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796725504 00000100:00100000:3.0:1788509333.224172:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788509333.224179:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:10050:x1875387796725504:12345-0@lo:502: 00000100:00100000:3.0:1788509333.224280:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:10050:x1875387796725504:12345-0@lo:502: Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.224286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788509333.224410:0:10050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10050:1875387796725504:0@lo:502: 00000100:00100000:2.0:1788509333.224454:0:10050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10050:1875387796725632:0@lo:502: 00000100:00100000:2.0:1788509333.224489:0:10050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509333.224515:0:10050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.224578:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796725632 00000100:00100000:1.0:1788509333.224582:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796725632 00000100:00100000:1.0:1788509333.224620:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788509333.224626:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:10050:x1875387796725632:12345-0@lo:502: 00000100:00100000:1.0:1788509333.224693:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:10050:x1875387796725632:12345-0@lo:502: Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.224699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788509333.224846:0:10050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10050:1875387796725632:0@lo:502: 00000040:00080000:2.0:1788509333.224865:0:10050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788509333.225089:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788509333.225109:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788509333.225118:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.225129:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509333.225138:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788509333.225140:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788509333.225143:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788509333.225167:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.225175:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.225183:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509333.225196:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796725760:0@lo:101: 00000100:00100000:1.0:1788509333.225223:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.225345:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.229659:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796725760 00000100:00100000:2.0:1788509333.229675:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796725760 00000100:00100000:2.0:1788509333.229741:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788509333.229752:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796725760:12345-0@lo:101: 00010000:00010000:2.0:1788509333.229767:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509333.229786:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd78e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.229811:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd78e expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.229823:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd78e expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.229847:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227a00, rc 0) 00000100:00100000:2.0:1788509333.230167:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796725760:12345-0@lo:101: Request processed in 416us (4942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.230173:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788509333.232127:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796725760:0@lo:101: 00010000:00010000:1.0:1788509333.232174:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.232186:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509333.232674:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796725888:0@lo:501: 00000100:00100000:1.0:1788509333.232735:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.232832:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509333.238190:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796725888 00000100:00100000:0.0:1788509333.238204:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796725888 00000100:00100000:0.0:1788509333.238565:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788509333.238575:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796725888:12345-0@lo:501: 00000100:00100000:0.0:1788509333.238746:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796725888:12345-0@lo:501: Request processed in 173us (6010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509333.238753:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788509333.240117:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796725888:0@lo:501: 00000100:00100000:3.0:1788509333.240171:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796726016:0@lo:503: 00000100:00100000:3.0:1788509333.240251:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.240290:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1788509333.240566:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796726016 00000100:00100000:0.0:1788509333.240573:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796726016 00000100:00100000:0.0:1788509333.240614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788509333.240622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796726016:12345-0@lo:503: 00000100:00100000:0.0:1788509333.240723:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796726016:12345-0@lo:503: Request processed in 100us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509333.240730:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788509333.241043:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796726016:0@lo:503: 00000100:00100000:2.0:1788509333.242162:0:10051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10051:1875387796726144:0@lo:502: 00000100:00100000:2.0:1788509333.242222:0:10051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509333.242350:0:10051:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788509333.248138:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796726144 00000100:00100000:0.0:1788509333.248154:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796726144 00000100:00100000:0.0:1788509333.248260:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788509333.248271:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:10051:x1875387796726144:12345-0@lo:502: 00000100:00100000:0.0:1788509333.248443:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:10051:x1875387796726144:12345-0@lo:502: Request processed in 175us (6220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509333.248451:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788509333.248547:0:10051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10051:1875387796726144:0@lo:502: 00000020:01000000:3.0:1788509333.248596:0:10051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509333.248606:0:10051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509333.248608:0:10051:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788509333.248613:0:10051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788509333.248615:0:10051:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788509333.248644:0:10051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10051:1875387796726272:0@lo:502: 00000100:00100000:3.0:1788509333.248686:0:10051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.261262:0:10051:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.261367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796726272 00000100:00100000:2.0:1788509333.261376:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796726272 00000100:00100000:2.0:1788509333.261418:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788509333.261426:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:10051:x1875387796726272:12345-0@lo:502: 00000100:00100000:2.0:1788509333.265051:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:10051:x1875387796726272:12345-0@lo:502: Request processed in 3614us (16354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.265068:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788509333.265762:0:10051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10051:1875387796726272:0@lo:502: 00000020:01000000:3.0:1788509333.265801:0:10051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509333.265808:0:10051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509333.265811:0:10051:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788509333.265814:0:10051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788509333.265878:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788509333.265935:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788509333.265945:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.265955:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509333.265965:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788509333.265967:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcdbbf0f800 from 39 10000000:01000000:3.0:1788509333.265970:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509333.266008:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.266016:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.266025:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.266043:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796726400:0@lo:101: 00000100:00100000:3.0:1788509333.266095:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.266133:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.266315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796726400 00000100:00100000:2.0:1788509333.266322:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796726400 00000100:00100000:2.0:1788509333.266354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788509333.266362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796726400:12345-0@lo:101: 00010000:00010000:2.0:1788509333.266374:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509333.266387:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd79c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.266407:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd79c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.266418:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd79c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.266433:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226c00, rc 0) 00000100:00100000:2.0:1788509333.266483:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796726400:12345-0@lo:101: Request processed in 121us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.266489:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788509333.267080:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796726400:0@lo:101: 00010000:00010000:3.0:1788509333.267097:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.267107:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.267165:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796726528:0@lo:501: 00000100:00100000:3.0:1788509333.267198:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.267223:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1788509333.267271:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796726528 00000100:00100000:0.0:1788509333.267276:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796726528 00000100:00100000:0.0:1788509333.267308:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788509333.267315:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796726528:12345-0@lo:501: 00000100:00100000:0.0:1788509333.267431:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796726528:12345-0@lo:501: Request processed in 116us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509333.267447:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788509333.267479:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796726528:0@lo:501: 00000100:00100000:0.0:1788509333.267504:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796726656:0@lo:503: 00000100:00100000:0.0:1788509333.267542:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.267649:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796726656 00000100:00100000:3.0:1788509333.267653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796726656 00000100:00100000:3.0:1788509333.267673:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788509333.267679:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796726656:12345-0@lo:503: 00000100:00100000:0.0:1788509333.270533:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767540 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.274751:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796726656:12345-0@lo:503: Request processed in 7062us (7199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.274765:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788509333.275140:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796726656:0@lo:503: 00000100:00100000:0.0:1788509333.276299:0:10054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10054:1875387796726784:0@lo:502: 00000100:00100000:0.0:1788509333.276366:0:10054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509333.277006:0:10054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767480 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.286325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796726784 00000100:00100000:3.0:1788509333.286340:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796726784 00000100:00100000:3.0:1788509333.286397:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788509333.286407:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:10054:x1875387796726784:12345-0@lo:502: 00000100:00100000:3.0:1788509333.286761:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:10054:x1875387796726784:12345-0@lo:502: Request processed in 355us (10394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.286769:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788509333.288136:0:10054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10054:1875387796726784:0@lo:502: 00000100:00100000:1.0:1788509333.288221:0:10054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10054:1875387796726912:0@lo:502: 00000100:00100000:1.0:1788509333.288282:0:10054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.288328:0:10054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271600 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.288373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796726912 00000100:00100000:3.0:1788509333.288379:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796726912 00000100:00100000:3.0:1788509333.288424:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788509333.288432:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:10054:x1875387796726912:12345-0@lo:502: 00000100:00100000:3.0:1788509333.288541:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:10054:x1875387796726912:12345-0@lo:502: Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.288547:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788509333.288630:0:10054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10054:1875387796726912:0@lo:502: 00000040:00080000:1.0:1788509333.288652:0:10054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788509333.288801:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788509333.288820:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509333.288830:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.288840:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509333.288849:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788509333.288852:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcdbbf0f800 from 6 10000000:01000000:3.0:1788509333.288855:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788509333.288881:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.288889:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.288938:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.288951:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727040:0@lo:101: 00000100:00100000:3.0:1788509333.288980:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.289004:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea900 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.289120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796727040 00000100:00100000:1.0:1788509333.289125:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796727040 00000100:00100000:1.0:1788509333.289158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788509333.289165:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796727040:12345-0@lo:101: 00010000:00010000:1.0:1788509333.289175:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509333.289187:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8c00/0xe5156b86310dd7b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd7aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289206:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8c00/0xe5156b86310dd7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd7aa expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289216:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8c00/0xe5156b86310dd7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd7aa expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289232:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8c00, rc 0) 00000100:00100000:1.0:1788509333.289269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796727040:12345-0@lo:101: Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.289275:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788509333.289319:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727040:0@lo:101: 00010000:00010000:1.0:1788509333.289331:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289340:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509333.289382:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727168:0@lo:256: 00000100:00100000:1.0:1788509333.289423:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.289439:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271240 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.289450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796727168 00000100:00100000:1.0:1788509333.289453:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796727168 00000100:00100000:1.0:1788509333.289473:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788509333.289479:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796727168:12345-0@lo:256: 20000000:01000000:1.0:1788509333.289491:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788509333.289507:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788509333.289510:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788509333.289593:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796727168:12345-0@lo:256: Request processed in 113us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.289600:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788509333.289632:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727168:0@lo:256: 10000000:01000000:1.0:1788509333.289669:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788509333.289678:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289686:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509333.289694:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788509333.289695:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1788509333.289698:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788509333.289714:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289720:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289727:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509333.289738:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727296:0@lo:101: 00000100:00100000:1.0:1788509333.289763:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.289777:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271240 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.289788:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796727296 00000100:00100000:1.0:1788509333.289792:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796727296 00000100:00100000:1.0:1788509333.289812:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788509333.289818:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796727296:12345-0@lo:101: 00010000:00010000:1.0:1788509333.289824:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509333.289831:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd7b8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289845:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289860:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.289867:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9c00, rc 0) 00000100:00100000:1.0:1788509333.290033:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796727296:12345-0@lo:101: Request processed in 214us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.290039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788509333.290072:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727296:0@lo:101: 00010000:00010000:1.0:1788509333.290083:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.290090:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509333.290133:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727424:0@lo:501: 00000100:00100000:1.0:1788509333.290157:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.290217:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271240 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.296135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796727424 00000100:00100000:3.0:1788509333.296149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796727424 00000100:00100000:3.0:1788509333.296237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788509333.296247:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796727424:12345-0@lo:501: 00000100:00100000:3.0:1788509333.296425:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796727424:12345-0@lo:501: Request processed in 179us (6266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.296432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788509333.302983:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727424:0@lo:501: 00000100:00100000:0.0:1788509333.303045:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727552:0@lo:503: 00000100:00100000:0.0:1788509333.303125:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509333.306815:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc877676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.310155:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796727552 00000100:00100000:1.0:1788509333.310170:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796727552 00000100:00100000:1.0:1788509333.310263:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788509333.310273:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796727552:12345-0@lo:503: 00000100:00100000:1.0:1788509333.310452:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796727552:12345-0@lo:503: Request processed in 180us (7325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.310460:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788509333.310533:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796727552:0@lo:503: 00000100:00100000:1.0:1788509333.326195:0:10057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10057:1875387796727680:0@lo:502: 00000100:00100000:1.0:1788509333.326293:0:10057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.326336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796727680 00000100:00100000:1.0:1788509333.326342:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796727680 00000100:00100000:1.0:1788509333.326385:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788509333.326394:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:10057:x1875387796727680:12345-0@lo:502: 00000100:00100000:1.0:1788509333.326511:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:10057:x1875387796727680:12345-0@lo:502: Request processed in 117us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.326518:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788509333.326585:0:10057:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271900 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.326606:0:10057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10057:1875387796727680:0@lo:502: 00000020:01000000:1.0:1788509333.326633:0:10057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788509333.326641:0:10057:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788509333.326648:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509333.326650:0:10057:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788509333.326654:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788509333.326658:0:10057:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1788509333.326678:0:10057:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788509333.326680:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509333.326695:0:10057:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8bcc863019c0) 00000020:00000080:1.0:1788509333.326719:0:10057:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788509333.326724:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788509333.326790:0:10057:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788509333.326796:0:10057:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788509333.326802:0:10057:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310dd7cd 00010000:00080000:1.0:1788509333.326827:0:10057:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc870ce800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509333.327077:0:10057:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788509333.327190:0:10057:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788509333.327200:0:10057:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788509333.327358:0:10057:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509333.327475:0:10057:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509333.327608:0:10057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788509333.327693:0:10057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788509333.328770:0:10058:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788509333.328776:0:10058:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00010000:1.0:1788509333.335618:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788509333.340621:0:10057:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788509333.340636:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788509333.340679:0:10057:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788509333.340702:0:10057:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310dd7d4 00000100:00080000:3.0:1788509333.340712:0:10057:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788509333.340718:0:10057:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8bcc870ce800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509333.340753:0:10057:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc865dc700 x1875387796727808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788509333.340781:0:10057:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788509333.340832:0:10057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509333.340836:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509333.340838:0:10057:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788509333.340841:0:10057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509333.340845:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509333.340856:0:10057:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788509333.340860:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788509333.340862:0:10057:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788509333.340888:0:10057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10057:1875387796727936:0@lo:502: 00000100:00100000:3.0:1788509333.340989:0:10057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.341023:0:10057:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea240 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.341043:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796727936 00000100:00100000:3.0:1788509333.341048:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796727936 00000100:00100000:3.0:1788509333.341083:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788509333.341091:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:10057:x1875387796727936:12345-0@lo:502: 00000100:00100000:3.0:1788509333.341202:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:10057:x1875387796727936:12345-0@lo:502: Request processed in 111us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.341209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788509333.341256:0:10057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10057:1875387796727936:0@lo:502: 00000020:01000000:3.0:1788509333.341279:0:10057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509333.341283:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509333.341284:0:10057:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788509333.341288:0:10057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1788509333.341507:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796727808:0@lo:8: 00000100:00100000:1.0:1788509333.341544:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788509333.341601:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788509333.341619:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788509333.341627:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.341638:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509333.341647:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788509333.341650:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd82e88800 from 39 10000000:01000000:1.0:1788509333.341653:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788509333.341675:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.341682:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.341692:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509333.341703:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796728064:0@lo:101: 00000100:00100000:1.0:1788509333.341727:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.341752:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.345954:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796728192:0@lo:400: 00000100:00100000:1.0:1788509333.346025:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346068:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796728704:0@lo:400: 00000100:00100000:1.0:1788509333.346089:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346108:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796729216:0@lo:400: 00000100:00100000:1.0:1788509333.346130:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346156:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788509333.346161:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796728320:0@lo:400: 00000100:00100000:1.0:1788509333.346184:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796728832:0@lo:400: 00000100:00100000:1.0:1788509333.346225:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346260:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796728576:0@lo:400: 00000100:00100000:1.0:1788509333.346283:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346300:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796729088:0@lo:400: 00000100:00100000:1.0:1788509333.346318:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346331:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788509333.346336:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796728448:0@lo:400: 00000100:00100000:1.0:1788509333.346354:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346366:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796728960:0@lo:400: 00000100:00100000:1.0:1788509333.346384:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.346414:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796728320 00000100:00100000:1.0:1788509333.346421:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796728320 00000100:00100000:1.0:1788509333.346471:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788509333.346480:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796728320:12345-0@lo:400: 00000100:00100000:1.0:1788509333.346532:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796728320:12345-0@lo:400: Request processed in 54us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.346548:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788509333.346596:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796728192 00000100:00100000:1.0:1788509333.346599:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796728192 00000100:00100000:1.0:1788509333.346620:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796728704 00000100:00100000:1.0:1788509333.346622:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796728704 00000100:00100000:1.0:1788509333.346643:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796729216 00000100:00100000:1.0:1788509333.346646:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796729216 00000100:00100000:1.0:1788509333.346658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796728576 00000100:00100000:1.0:1788509333.346660:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796728576 00000100:00100000:1.0:1788509333.346669:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796729088 00000100:00100000:1.0:1788509333.346672:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796729088 00000100:00100000:1.0:1788509333.346682:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796728448 00000100:00100000:1.0:1788509333.346685:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796728448 00000100:00100000:1.0:1788509333.346697:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788509333.346703:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796728192:12345-0@lo:400: 00000100:00100000:1.0:1788509333.346735:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796728192:12345-0@lo:400: Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.346741:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788509333.346754:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788509333.346761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796728704:12345-0@lo:400: 00000100:00100000:1.0:1788509333.346788:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796728704:12345-0@lo:400: Request processed in 28us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.346794:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788509333.346806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788509333.346812:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796729216:12345-0@lo:400: 00000100:00100000:1.0:1788509333.346840:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796729216:12345-0@lo:400: Request processed in 28us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.346846:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788509333.346867:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788509333.346873:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796728576:12345-0@lo:400: 00000100:00100000:1.0:1788509333.346938:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796728576:12345-0@lo:400: Request processed in 65us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.346946:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788509333.346959:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788509333.346966:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796729088:12345-0@lo:400: 00000100:00100000:1.0:1788509333.346992:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796729088:12345-0@lo:400: Request processed in 27us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.346997:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788509333.347009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788509333.347014:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796728448:12345-0@lo:400: 00000100:00100000:1.0:1788509333.347040:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796728448:12345-0@lo:400: Request processed in 26us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.347045:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788509333.347064:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796727808 00000100:00100000:1.0:1788509333.347068:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796727808 00000100:00100000:1.0:1788509333.347085:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796728832 00000100:00100000:1.0:1788509333.347087:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796728832 00000100:00100000:1.0:1788509333.347101:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796728960 00000100:00100000:1.0:1788509333.347103:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796728960 00000100:00100000:1.0:1788509333.347115:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509333.347121:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796728832:12345-0@lo:400: 00000100:00100000:1.0:1788509333.347149:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796728832:12345-0@lo:400: Request processed in 29us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.347155:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509333.347166:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788509333.347179:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796728960:12345-0@lo:400: 00000100:00100000:1.0:1788509333.347205:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796728960:12345-0@lo:400: Request processed in 27us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.347211:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788509333.347223:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509333.347227:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875387796727808:12345-0@lo:8: 00010000:00080000:1.0:1788509333.347252:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1788509333.347283:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310dd7e2 00002000:00100000:1.0:1788509333.347297:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8bcdbd328800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788509333.347303:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788509333.347306:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788509333.347369:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788509333.347680:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788509333.347703:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcdbd329000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509333.347747:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875387796727808:12345-0@lo:8: Request processed in 518us (6201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.347753:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788509333.347800:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc865dc700 x1875387796727808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788509343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.347811:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788509333.347819:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788509333.347827:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788509333.347832:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788509333.347834:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc870ce800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788509333.347845:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788509333.347850:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796727808:0@lo:8: 00010000:00080000:1.0:1788509333.347891:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc874da300 x1875387796728448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.347923:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796728448:0@lo:400: 00010000:00080000:1.0:1788509333.347934:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc874d8e00 x1875387796728960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.347942:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796728960:0@lo:400: 00010000:00080000:1.0:1788509333.347951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc874daa00 x1875387796728576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.347958:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796728576:0@lo:400: 00010000:00080000:1.0:1788509333.347967:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5ea00 x1875387796729088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.347975:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796729088:0@lo:400: 00000100:00100000:1.0:1788509333.348006:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796728320:0@lo:400: 00010000:00080000:1.0:1788509333.348017:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc874d9500 x1875387796728832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.348025:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796728832:0@lo:400: 00010000:00080000:1.0:1788509333.348034:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc874db100 x1875387796728192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.348040:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796728192:0@lo:400: 00010000:00080000:1.0:1788509333.348049:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc874d9f80 x1875387796728704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.348055:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796728704:0@lo:400: 00010000:00080000:1.0:1788509333.348074:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5e300 x1875387796729216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.348082:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796729216:0@lo:400: 00000004:00080000:1.0:1788509333.348106:0:10058:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788509333.348156:0:10058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 230509257240ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788509333.348162:0:10058:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788509333.348213:0:10059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10059:1875387796729344:0@lo:700: 00000100:00100000:1.0:1788509333.348245:0:10059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.348266:0:10059:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271180 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.348828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796728064 00000100:00100000:2.0:1788509333.348835:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796728064 00000100:00100000:2.0:1788509333.348874:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788509333.348881:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796728064:12345-0@lo:101: 00010000:00010000:2.0:1788509333.348921:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509333.348938:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd7db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.348963:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd7db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.348974:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd7db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.348984:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227000, rc 0) 00000100:00100000:2.0:1788509333.349027:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796728064:12345-0@lo:101: Request processed in 146us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.349033:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788509333.349078:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509333.349083:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509333.349085:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509333.349644:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796729344 00000100:00100000:0.0:1788509333.349652:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796729344 00000100:00100000:0.0:1788509333.349704:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509333.349711:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10059:x1875387796729344:12345-0@lo:700: 00000100:00100000:0.0:1788509333.349751:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1875387796729472:0@lo:700: 00000100:00100000:0.0:1788509333.349788:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509333.349810:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767780 going to sleep for 11 seconds 00000100:00100000:0.0:1788509333.349844:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796729472 00000100:00100000:0.0:1788509333.349848:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796729472 00000100:00100000:0.0:1788509333.349873:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509333.349879:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1875387796729472:12345-0@lo:700: 00000100:00080000:3.0:1788509333.349981:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509333.350064:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796728064:0@lo:101: 00010000:00010000:1.0:1788509333.350082:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.350093:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509333.350167:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796729600:0@lo:501: 00000100:00100000:1.0:1788509333.350194:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.350236:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.350289:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796729600 00000100:00100000:3.0:1788509333.350293:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796729600 00000100:00100000:3.0:1788509333.350325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788509333.350331:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796729600:12345-0@lo:501: 00000100:00100000:3.0:1788509333.350446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796729600:12345-0@lo:501: Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.350453:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788509333.350523:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796729600:0@lo:501: 00000100:00100000:1.0:1788509333.350548:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796729728:0@lo:503: 00000100:00100000:1.0:1788509333.350592:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.350620:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.350663:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796729728 00000100:00100000:3.0:1788509333.350667:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796729728 00000100:00100000:3.0:1788509333.350697:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788509333.350709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796729728:12345-0@lo:503: 00000100:00100000:3.0:1788509333.350781:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796729728:12345-0@lo:503: Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.350787:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788509333.350823:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796729728:0@lo:503: 00000100:00100000:3.0:1788509333.351004:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10060:1875387796729856:0@lo:502: 00000100:00100000:3.0:1788509333.351036:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.351053:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796729856 00000100:00100000:3.0:1788509333.351057:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796729856 00000100:00100000:3.0:1788509333.351074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788509333.351080:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10060:x1875387796729856:12345-0@lo:502: 00000100:00100000:3.0:1788509333.351143:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10060:x1875387796729856:12345-0@lo:502: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.351149:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788509333.351175:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.351186:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10060:1875387796729856:0@lo:502: 00000100:00100000:3.0:1788509333.351222:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10060:1875387796729984:0@lo:502: 00000100:00100000:3.0:1788509333.351250:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.351266:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796729984 00000100:00100000:3.0:1788509333.351269:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796729984 00000100:00100000:3.0:1788509333.351284:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788509333.351289:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10060:x1875387796729984:12345-0@lo:502: 00000100:00100000:3.0:1788509333.351343:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10060:x1875387796729984:12345-0@lo:502: Request processed in 53us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.351349:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788509333.351378:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.351389:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10060:1875387796729984:0@lo:502: 00000040:00080000:3.0:1788509333.351405:0:10060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788509333.351446:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788509333.351466:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509333.351473:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.351482:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509333.351490:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788509333.351493:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd82e88800 from 6 10000000:01000000:3.0:1788509333.351496:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788509333.351517:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.351525:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.351533:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.351545:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730112:0@lo:101: 00000100:00100000:3.0:1788509333.351582:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.351595:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.351606:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796730112 00000100:00100000:3.0:1788509333.351609:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796730112 00000100:00100000:3.0:1788509333.351625:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788509333.351630:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796730112:12345-0@lo:101: 00010000:00010000:3.0:1788509333.351646:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509333.351657:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92924e00/0xe5156b86310dd7f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd7f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.351674:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924e00/0xe5156b86310dd7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd7f0 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.351683:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92924e00/0xe5156b86310dd7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd7f0 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.351690:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924e00, rc 0) 00000100:00100000:3.0:1788509333.351718:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796730112:12345-0@lo:101: Request processed in 88us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.351724:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788509333.351747:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730112:0@lo:101: 00010000:00010000:3.0:1788509333.351756:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.351764:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.351802:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730240:0@lo:256: 00000100:00100000:3.0:1788509333.351828:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.351841:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.351851:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796730240 00000100:00100000:3.0:1788509333.351854:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796730240 00000100:00100000:3.0:1788509333.351870:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788509333.351876:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796730240:12345-0@lo:256: 20000000:01000000:3.0:1788509333.351895:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788509333.351931:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788509333.351934:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788509333.352000:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796730240:12345-0@lo:256: Request processed in 124us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.352006:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788509333.352032:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730240:0@lo:256: 10000000:01000000:3.0:1788509333.352070:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788509333.352076:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.352083:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509333.352090:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788509333.352091:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788509333.352093:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788509333.352107:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.352114:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.352121:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.352131:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730368:0@lo:101: 00000100:00100000:3.0:1788509333.352154:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.352167:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.352183:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796730368 00000100:00100000:3.0:1788509333.352186:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796730368 00000100:00100000:3.0:1788509333.352203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788509333.352207:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796730368:12345-0@lo:101: 00010000:00010000:3.0:1788509333.352213:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509333.352221:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd7fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.352234:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.352242:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.352249:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924800, rc 0) 00000100:00100000:3.0:1788509333.352274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796730368:12345-0@lo:101: Request processed in 66us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.352279:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788509333.352304:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730368:0@lo:101: 00010000:00010000:3.0:1788509333.352314:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509333.352321:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509333.352359:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730496:0@lo:501: 00000100:00100000:3.0:1788509333.352381:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.352393:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.352402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796730496 00000100:00100000:3.0:1788509333.352410:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796730496 00000100:00100000:3.0:1788509333.352426:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788509333.352431:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796730496:12345-0@lo:501: 00000100:00100000:3.0:1788509333.352517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796730496:12345-0@lo:501: Request processed in 85us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.352522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788509333.352571:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730496:0@lo:501: 00000100:00100000:3.0:1788509333.352593:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730624:0@lo:503: 00000100:00100000:3.0:1788509333.352627:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.352639:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.352649:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796730624 00000100:00100000:3.0:1788509333.352653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796730624 00000100:00100000:3.0:1788509333.352669:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788509333.352675:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796730624:12345-0@lo:503: 00000100:00100000:3.0:1788509333.352745:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796730624:12345-0@lo:503: Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.352751:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788509333.352785:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796730624:0@lo:503: 00000004:00080000:1.0:1788509333.355580:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788509333.356789:0:10061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10061:1875387796730752:0@lo:502: 00000100:00100000:3.0:1788509333.356877:0:10061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.356941:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796730752 00000100:00100000:3.0:1788509333.356947:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796730752 00000100:00100000:3.0:1788509333.356988:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788509333.356996:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10061:x1875387796730752:12345-0@lo:502: 00000100:00100000:3.0:1788509333.357107:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10061:x1875387796730752:12345-0@lo:502: Request processed in 111us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.357124:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788509333.357174:0:10061:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.357194:0:10061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10061:1875387796730752:0@lo:502: 00000020:01000000:3.0:1788509333.357221:0:10061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788509333.357229:0:10061:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788509333.357235:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509333.357237:0:10061:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788509333.357242:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788509333.357246:0:10061:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1788509333.357268:0:10061:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788509333.357271:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788509333.357285:0:10061:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8bcc870f0000) 00000020:00000080:3.0:1788509333.357308:0:10061:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788509333.357313:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788509333.357395:0:10061:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788509333.357402:0:10061:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788509333.357408:0:10061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dd813 00010000:00080000:3.0:1788509333.357439:0:10061:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc870c9000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509333.366607:0:10061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788509333.366751:0:10061:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788509333.366771:0:10061:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788509333.366981:0:10061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509333.367091:0:10061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509333.367219:0:10061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788509333.367315:0:10061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 40000000:02000000:2.0:1788509333.376302:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:00080000:1.0:1788509333.383220:0:10062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788509333.383230:0:10062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788509333.389566:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1875387796729472:12345-0@lo:700: Request processed in 39669us (39759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.389594:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788509333.389667:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc870b5c00 x1875387796729472/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509333.389680:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1875387796729472:0@lo:700: 40000000:02000000:2.0:1788509333.389692:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:00000080:1.0:1788509333.395036:0:10061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788509333.395052:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788509333.395092:0:10061:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788509333.395118:0:10061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dd81a 00000100:00080000:1.0:1788509333.395130:0:10061:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788509333.395135:0:10061:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bcc870c9000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509333.395170:0:10061:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb5c5c380 x1875387796730880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788509333.395200:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796730880:0@lo:8: 00000100:00100000:1.0:1788509333.395277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.395346:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796730880 00000100:00100000:1.0:1788509333.395354:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796730880 00000100:00100000:1.0:1788509333.395388:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788509333.395395:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875387796730880:12345-0@lo:8: 00010000:00080000:1.0:1788509333.395422:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1788509333.395455:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dd821 00002000:00100000:1.0:1788509333.395469:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8bcdb5972800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788509333.395474:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788509333.395476:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788509333.395547:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788509333.395584:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcdb5972000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509333.395642:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875387796730880:12345-0@lo:8: Request processed in 245us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.395650:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788509333.395700:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5c380 x1875387796730880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788509343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.395710:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788509333.395717:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788509333.395723:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788509333.395727:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788509333.395729:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc870c9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788509333.395738:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788509333.395743:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796730880:0@lo:8: 00000004:00080000:1.0:1788509333.395764:0:10062:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788509333.395810:0:10062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 230556911195ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788509333.395817:0:10062:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1788509333.395845:0:10061:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788509333.395970:0:10061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509333.395975:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509333.395977:0:10061:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788509333.395981:0:10061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509333.395985:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509333.395986:0:10061:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788509333.395988:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788509333.395990:0:10061:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788509333.396016:0:10061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10061:1875387796731008:0@lo:502: 00000100:00100000:1.0:1788509333.396062:0:10061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.396088:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796731008 00000100:00100000:1.0:1788509333.396092:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796731008 00000100:00100000:1.0:1788509333.396121:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788509333.396135:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10061:x1875387796731008:12345-0@lo:502: 00000100:00100000:1.0:1788509333.396240:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10061:x1875387796731008:12345-0@lo:502: Request processed in 106us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.396247:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788509333.396288:0:10061:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8918ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.396303:0:10061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10061:1875387796731008:0@lo:502: 00000020:01000000:1.0:1788509333.396322:0:10061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509333.396326:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509333.396328:0:10061:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788509333.396332:0:10061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788509333.396384:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788509333.396400:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788509333.396410:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.396422:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509333.396432:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788509333.396434:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bcd9e5d99c0 from 1 10000000:01000000:1.0:1788509333.396438:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788509333.396462:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.396470:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509333.396477:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509333.396501:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796731136:0@lo:101: 00000100:00100000:1.0:1788509333.396526:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.396550:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8918ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.403358:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796731136 00000100:00100000:2.0:1788509333.403372:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796731136 00000100:00100000:2.0:1788509333.403450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788509333.403459:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796731136:12345-0@lo:101: 00010000:00010000:2.0:1788509333.403477:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509333.403494:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd828 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.403521:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd828 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.403533:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd828 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.403542:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226600, rc 0) 00000100:00100000:2.0:1788509333.403627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796731136:12345-0@lo:101: Request processed in 169us (7099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.403633:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788509333.403697:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796731136:0@lo:101: 00010000:00010000:2.0:1788509333.403724:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.403752:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509333.403822:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796731264:0@lo:501: 00000100:00100000:2.0:1788509333.403854:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509333.403884:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.403918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796731264 00000100:00100000:2.0:1788509333.403922:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796731264 00000100:00100000:2.0:1788509333.403944:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788509333.403951:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796731264:12345-0@lo:501: 00000100:00100000:2.0:1788509333.404024:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796731264:12345-0@lo:501: Request processed in 73us (169us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509333.404031:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788509333.404061:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796731264:0@lo:501: 10000000:01000000:2.0:1788509333.404089:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788509333.404095:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509333.404103:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788509333.407261:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788509333.407272:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788509333.410030:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10059:x1875387796729344:12345-0@lo:700: Request processed in 60311us (61776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509333.410043:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788509333.410100:0:10059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5e300 x1875387796729344/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509333.410115:0:10059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10059:1875387796729344:0@lo:700: 00000004:00080000:2.0:1788509333.415971:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788509333.416128:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509333.416148:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796731392:0@lo:13: 00000100:00100000:3.0:1788509333.416220:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788509333.416256:0:10064:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788509333.416277:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10064:1875387796731520:0@lo:7: 00000100:00100000:3.0:1788509333.416302:0:10064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509333.416316:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.416477:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796731392 00000100:00100000:2.0:1788509333.416485:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796731392 00000100:00100000:2.0:1788509333.416545:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509333.416563:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796731392:12345-0@lo:13: 00002000:00000024:2.0:1788509333.416599:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788509333.416654:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796731392:12345-0@lo:13: Request processed in 100us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.416661:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509333.416684:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796731520 00000100:00100000:2.0:1788509333.416688:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796731520 00000100:00100000:2.0:1788509333.416712:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509333.416719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10064:x1875387796731520:12345-0@lo:7: 00010000:00080000:1.0:1788509333.419974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc865dea00 x1875387796731392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.420001:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796731392:0@lo:13: 00000100:00080000:3.0:1788509333.420700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788509333.425226:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788509333.425234:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788509333.425462:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10064:x1875387796731520:12345-0@lo:7: Request processed in 8738us (9154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.425472:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788509333.426330:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc865dc700 x1875387796731520/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509333.426346:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10064:1875387796731520:0@lo:7: 00000004:00080000:0.0:1788509333.426360:0:10064:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788509333.426397:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10064:1875387796731648:0@lo:5: 00000100:00100000:0.0:1788509333.426436:0:10064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509333.426472:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.426756:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796731648 00000100:00100000:2.0:1788509333.426763:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796731648 00000100:00100000:2.0:1788509333.426850:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788509333.426860:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10064:x1875387796731648:12345-0@lo:5: 00002000:00080000:2.0:1788509333.426884:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788509333.426888:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788509333.427215:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10064:x1875387796731648:12345-0@lo:5: Request processed in 357us (777us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788509333.427222:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:1.0:1788509333.436176:0:10059:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788509333.436208:0:10059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10059:1875387796731904:0@lo:7: 00000100:00100000:1.0:1788509333.436271:0:10059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.436324:0:10059:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8918ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.436337:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509333.436348:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796731776:0@lo:13: 00000100:00100000:1.0:1788509333.436373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788509333.436456:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc870b5500 x1875387796731648/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.436472:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10064:1875387796731648:0@lo:5: 00000004:00080000:1.0:1788509333.436483:0:10064:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788509333.436506:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10064:1875387796732032:0@lo:700: 00000100:00100000:1.0:1788509333.436530:0:10064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.436548:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8918c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.436676:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796731776 00000100:00100000:2.0:1788509333.436683:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796731776 00000100:00100000:2.0:1788509333.436723:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788509333.436743:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796731776:12345-0@lo:13: 00002000:00000024:2.0:1788509333.436763:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788509333.436813:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796731776:12345-0@lo:13: Request processed in 82us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.436833:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788509333.437046:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796731904 00000100:00100000:2.0:1788509333.437050:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796731904 00000100:00100000:2.0:1788509333.437076:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788509333.437082:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10059:x1875387796731904:12345-0@lo:7: 00010000:00080000:1.0:1788509333.438916:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5c700 x1875387796731776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509333.438942:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796731776:0@lo:13: 00000100:00100000:1.0:1788509333.440020:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796732032 00000100:00100000:1.0:1788509333.440029:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796732032 00000100:00100000:1.0:1788509333.440082:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509333.440092:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10064:x1875387796732032:12345-0@lo:700: 00002000:00080000:1.0:1788509333.455542:0:8756:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788509333.455551:0:8756:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788509333.455668:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10059:x1875387796731904:12345-0@lo:7: Request processed in 18581us (19392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.455679:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788509333.455962:0:10059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5ca80 x1875387796731904/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509333.455976:0:10059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10059:1875387796731904:0@lo:7: 00000004:00080000:2.0:1788509333.455996:0:10059:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788509333.456032:0:10059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10059:1875387796732160:0@lo:5: 00000100:00100000:2.0:1788509333.456080:0:10059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509333.456115:0:10059:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84780 going to sleep for 11 seconds 00000100:00100000:1.0:1788509333.456614:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796732160 00000100:00100000:1.0:1788509333.456622:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796732160 00000100:00100000:1.0:1788509333.456669:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788509333.456678:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10059:x1875387796732160:12345-0@lo:5: 00002000:00080000:1.0:1788509333.456703:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788509333.456760:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10059:x1875387796732160:12345-0@lo:5: Request processed in 82us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.456766:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788509333.456937:0:10059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781880 x1875387796732160/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509333.456948:0:10059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10059:1875387796732160:0@lo:5: 00000004:00080000:2.0:1788509333.456957:0:10059:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788509333.456982:0:10059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10059:1875387796732288:0@lo:5: 00000100:00100000:2.0:1788509333.457009:0:10059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509333.457026:0:10059:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84780 going to sleep for 11 seconds 00000100:00100000:2.0:1788509333.457045:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796732288 00000100:00100000:2.0:1788509333.457048:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796732288 00000100:00100000:2.0:1788509333.457074:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788509333.457080:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10059:x1875387796732288:12345-0@lo:5: 00002000:00080000:2.0:1788509333.457103:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788509333.458671:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:10059:x1875387796732288:12345-0@lo:5: Request processed in 1586us (1657us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788509333.458680:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788509333.458728:0:10059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781880 x1875387796732288/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509333.458742:0:10059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10059:1875387796732288:0@lo:5: 00000004:00080000:2.0:1788509333.458754:0:10059:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788509333.458787:0:10059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10059:1875387796732416:0@lo:900: 00000100:00100000:2.0:1788509333.458819:0:10059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509333.458837:0:10059:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84780 going to sleep for 11 seconds 00000100:00100000:3.0:1788509333.459159:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796732416 00000100:00100000:3.0:1788509333.459165:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796732416 00000100:00100000:3.0:1788509333.459206:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509333.459214:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10059:x1875387796732416:12345-0@lo:900: 00000100:00100000:3.0:1788509333.459268:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10059:x1875387796732416:12345-0@lo:900: Request processed in 56us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509333.459274:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000001:00080000:3.0:1788509333.462379:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1788509333.462546:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10064:x1875387796732032:12345-0@lo:700: Request processed in 22453us (26012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509333.462569:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788509333.462867:0:10059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87783480 x1875387796732416/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509333.462882:0:10059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10059:1875387796732416:0@lo:900: 00010000:00080000:3.0:1788509333.463083:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5e300 x1875387796732032/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509333.463102:0:10064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788509333.463116:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10064:1875387796732032:0@lo:700: 00000004:02000040:3.0:1788509333.465609:0:10064:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788509333.480870:0:10064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10064:1875387796732544:0@lo:5: 00000100:00100000:2.0:1788509333.480963:0:10064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509333.481010:0:10064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84780 going to sleep for 11 seconds 00000100:00100000:0.0:1788509333.481075:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796732544 00000100:00100000:0.0:1788509333.481083:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796732544 00000100:00100000:0.0:1788509333.481135:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788509333.481144:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10064:x1875387796732544:12345-0@lo:5: 00002000:00080000:0.0:1788509333.495449:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788509333.495469:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788509333.497836:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10064:x1875387796732544:12345-0@lo:5: Request processed in 16686us (16865us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788509333.497849:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788509333.500883:0:10064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87783480 x1875387796732544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509349 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509333.500972:0:10064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10064:1875387796732544:0@lo:5: 00000004:00080000:2.0:1788509333.500990:0:10064:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:1.0:1788509333.720994:0:10088:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788509333.721003:0:10088:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788509333.722042:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509333.722511:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796732672:0@lo:41: 00000100:00100000:3.0:1788509333.722586:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509333.728445:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796732672 00000100:00100000:1.0:1788509333.728578:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796732672 00000100:00100000:1.0:1788509333.728648:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788509333.728659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796732672:12345-0@lo:41: 00000004:00000024:1.0:1788509333.728694:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788509333.728881:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796732672:12345-0@lo:41: Request processed in 223us (6294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509333.729063:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796732672:0@lo:41: 00000100:00100000:1.0:1788509333.729435:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788509334.230759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796732800:0@lo:13: 00000100:00100000:1.0:1788509334.230842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509334.230970:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509334.230977:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796732928:0@lo:13: 00000100:00100000:1.0:1788509334.231013:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509334.231197:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796732800 00000100:00100000:3.0:1788509334.231208:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796732800 00000100:00100000:3.0:1788509334.231272:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796732928 00000100:00100000:3.0:1788509334.231276:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796732928 00000100:00100000:3.0:1788509334.231295:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509334.231306:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796732800:12345-0@lo:13: 00002000:00000024:3.0:1788509334.231345:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509334.231407:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796732800:12345-0@lo:13: Request processed in 103us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509334.231415:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509334.231451:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788509334.231470:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796732928:12345-0@lo:13: 00002000:00000024:3.0:1788509334.231481:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509334.231509:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796732928:12345-0@lo:13: Request processed in 39us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509334.231515:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788509334.231679:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc870b7b80 x1875387796732928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509334.231702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796732928:0@lo:13: 00010000:00080000:3.0:1788509334.231719:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781c00 x1875387796732800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509334.231732:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796732800:0@lo:13: 00000100:00100000:0.0:1788509334.274983:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509334.275027:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774664832 00000100:00100000:2.0:1788509334.275203:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774664832 00000100:00100000:1.0:1788509334.275370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:1.0:1788509334.275381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1875387774664832:12345-192.168.203.12@tcp:250: 00010000:00080000:1.0:1788509334.275418:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ac7445cb-a9c1-4029-81e7-bb23f1aa1f24@192.168.203.12@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:1.0:1788509334.275457:0:6513:0:(genops.c:1385:class_connect()) connect: client ac7445cb-a9c1-4029-81e7-bb23f1aa1f24, cookie 0xe5156b86310dd836 00000100:00080000:1.0:1788509334.275680:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8bcdb5975000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509334.275777:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+5:2406:x1875387774664832:12345-192.168.203.12@tcp:250: Request processed in 395us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509334.275786:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:3.0:1788509334.282729:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509334.284257:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774664960 00000100:00100000:2.0:1788509334.284277:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774664960 00000100:00100000:2.0:1788509334.284389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:2.0:1788509334.284402:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+5:6167:x1875387774664960:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788509334.284423:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509334.284448:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509334.284486:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509334.284499:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509334.284509:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227e00, rc 0) 00000100:00100000:0.0:1788509334.286396:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+6:6167:x1875387774664960:12345-192.168.203.12@tcp:101: Request processed in 1984us (3668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509334.286410:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:3.0:1788509334.302255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509334.303965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774665088 00000100:00100000:2.0:1788509334.303985:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774665088 00000100:00100000:2.0:1788509334.304078:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:2.0:1788509334.304892:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+6:6167:x1875387774665088:12345-192.168.203.12@tcp:501: 00000100:00100000:2.0:1788509334.305428:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+6:6167:x1875387774665088:12345-192.168.203.12@tcp:501: Request processed in 558us (3186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509334.305439:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:2.0:1788509334.309973:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509334.310248:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774665216 00000100:00100000:0.0:1788509334.310262:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774665216 00000100:00100000:0.0:1788509334.310335:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:0.0:1788509334.310347:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+6:6167:x1875387774665216:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1788509334.310369:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509334.310393:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f14 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509334.310431:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509334.310445:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509334.310456:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b800, rc 0) 00000100:00100000:0.0:1788509334.310585:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+7:6167:x1875387774665216:12345-192.168.203.12@tcp:101: Request processed in 239us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509334.310593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:3.0:1788509334.315193:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509334.315616:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774665344 00000100:00100000:1.0:1788509334.315629:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774665344 00000100:00100000:1.0:1788509334.315753:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:1.0:1788509334.315766:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+7:6167:x1875387774665344:12345-192.168.203.12@tcp:501: 00000100:00100000:1.0:1788509334.316051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+8:6167:x1875387774665344:12345-192.168.203.12@tcp:501: Request processed in 286us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509334.316059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788509334.318604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509334.319568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774665472 00000100:00100000:0.0:1788509334.319583:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774665472 00000100:00100000:0.0:1788509334.319646:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:0.0:1788509334.319657:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+8:6167:x1875387774665472:12345-192.168.203.12@tcp:503: 00000100:00100000:3.0:1788509334.323509:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509334.323801:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774665600 00000100:00100000:2.0:1788509334.323816:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774665600 00000100:00100000:2.0:1788509334.323889:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:2.0:1788509334.323983:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6186:x1875387774665600:12345-192.168.203.12@tcp:502: 00000100:00100000:0.0:1788509334.324394:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6167:x1875387774665472:12345-192.168.203.12@tcp:503: Request processed in 192us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509334.324406:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:2.0:1788509334.324615:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+8:6186:x1875387774665600:12345-192.168.203.12@tcp:502: Request processed in 716us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509334.324637:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00010000:00010000:2.0:1788509334.359183:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509334.378842:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509334.379729:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774665728 00000100:00100000:0.0:1788509334.379745:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774665728 00000100:00100000:0.0:1788509334.379821:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:0.0:1788509334.379857:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+8:6186:x1875387774665728:12345-192.168.203.12@tcp:502: 00000100:00100000:0.0:1788509334.380240:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+8:6186:x1875387774665728:12345-192.168.203.12@tcp:502: Request processed in 392us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509334.380249:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:3.0:1788509334.382694:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509334.383262:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774665856 00000100:00100000:1.0:1788509334.383275:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774665856 00000100:00100000:1.0:1788509334.383349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:1.0:1788509334.383361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+8:6167:x1875387774665856:12345-192.168.203.12@tcp:101: 00010000:00010000:1.0:1788509334.383397:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509334.383421:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8600/0xe5156b86310dd84b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f45 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509334.383469:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8600/0xe5156b86310dd84b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f45 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509334.383484:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8600/0xe5156b86310dd84b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f45 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509334.383496:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8600, rc 0) 00000100:00100000:1.0:1788509334.383587:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6167:x1875387774665856:12345-192.168.203.12@tcp:101: Request processed in 227us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509334.383595:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:3.0:1788509334.387296:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509334.390065:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774665984 00000100:00100000:2.0:1788509334.390088:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774665984 00000100:00100000:2.0:1788509334.390189:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:2.0:1788509334.390202:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6167:x1875387774665984:12345-192.168.203.12@tcp:256: 20000000:01000000:2.0:1788509334.390235:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788509334.390283:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788509334.390287:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788509334.390291:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788509334.390294:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788509334.391414:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788509334.399180:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6167:x1875387774665984:12345-192.168.203.12@tcp:256: Request processed in 8633us (11552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509334.399202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:3.0:1788509334.403024:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509334.403278:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774666112 00000100:00100000:0.0:1788509334.403291:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774666112 00000100:00100000:0.0:1788509334.403364:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:0.0:1788509334.403377:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6167:x1875387774666112:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1788509334.403400:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509334.403426:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f4c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509334.403474:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509334.403487:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509334.403497:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590ae00, rc 0) 00000100:00100000:0.0:1788509334.403576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6167:x1875387774666112:12345-192.168.203.12@tcp:101: Request processed in 201us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509334.403583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:0.0:1788509334.409330:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509334.409442:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774666240 00000100:00100000:2.0:1788509334.409465:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774666240 00000100:00100000:2.0:1788509334.409582:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1788509334.409595:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6167:x1875387774666240:12345-192.168.203.12@tcp:501: 00000100:00100000:2.0:1788509334.410071:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6167:x1875387774666240:12345-192.168.203.12@tcp:501: Request processed in 476us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509334.410081:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:3.0:1788509334.413002:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509334.413397:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774666368 00000100:00100000:1.0:1788509334.413412:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774666368 00000100:00100000:1.0:1788509334.413602:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:1.0:1788509334.413616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6167:x1875387774666368:12345-192.168.203.12@tcp:503: 00000100:00100000:1.0:1788509334.413841:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6167:x1875387774666368:12345-192.168.203.12@tcp:503: Request processed in 227us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509334.413861:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:3.0:1788509334.418027:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509334.418292:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774666496 00000100:00100000:2.0:1788509334.418305:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774666496 00000100:00100000:2.0:1788509334.418378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:2.0:1788509334.418391:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6193:x1875387774666496:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1788509334.418617:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6193:x1875387774666496:12345-192.168.203.12@tcp:502: Request processed in 228us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509334.418626:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:3.0:1788509334.420777:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509334.421421:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774666624 00000100:00100000:1.0:1788509334.421435:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774666624 00000100:00100000:1.0:1788509334.421576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:1.0:1788509334.421589:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6193:x1875387774666624:12345-192.168.203.12@tcp:502: 00000100:00100000:1.0:1788509334.421833:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6193:x1875387774666624:12345-192.168.203.12@tcp:502: Request processed in 243us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509334.422080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:3.0:1788509334.425538:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509334.425595:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509334.426341:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774666752 00000100:00100000:2.0:1788509334.426355:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774666752 00000100:00100000:2.0:1788509334.426415:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774667008 00000100:00100000:2.0:1788509334.426419:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774667008 00000100:00100000:2.0:1788509334.426459:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788509334.426470:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875387774666752:12345-192.168.203.12@tcp:38: 00010000:00080000:2.0:1788509334.426508:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1788509334.426597:0:6522:0:(genops.c:1385:class_connect()) connect: client d1c7a223-cc58-4f2c-be22-e37eba96eeae, cookie 0xe5156b86310dd859 00000004:00100000:2.0:1788509334.426630:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788509334.427032:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1788509334.427039:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875387774667008:12345-192.168.203.12@tcp:38: 00010000:00080000:0.0:1788509334.427058:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1788509334.427219:0:6521:0:(genops.c:1385:class_connect()) connect: client d1c7a223-cc58-4f2c-be22-e37eba96eeae, cookie 0xe5156b86310dd860 00000004:00100000:0.0:1788509334.427237:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788509334.427414:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8bcdb59c6800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788509334.427705:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8bcdb786a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509334.427806:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2406:x1875387774667008:12345-192.168.203.12@tcp:38: Request processed in 764us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509334.427816:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788509334.427881:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2406:x1875387774666752:12345-192.168.203.12@tcp:38: Request processed in 1412us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509334.427971:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00010000:00010000:1.0:1788509335.384240:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509335.432986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509335.433158:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509335.436223:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509335.436357:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774667136 00000100:00100000:0.0:1788509335.436370:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774667136 00000100:00100000:0.0:1788509335.436465:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774667264 00000100:00100000:0.0:1788509335.436470:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774667264 00000100:00100000:0.0:1788509335.436491:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774666880 00000100:00100000:0.0:1788509335.436494:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774666880 00000100:00100000:0.0:1788509335.436508:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788509335.436519:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:0:x1875387774667136:12345-192.168.203.12@tcp:41: 00000004:00000024:0.0:1788509335.436580:0:9006:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788509335.436659:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:0:x1875387774667136:12345-192.168.203.12@tcp:41: Request processed in 141us (3689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509335.436668:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788509335.436687:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788509335.436694:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:6167:x1875387774667264:12345-192.168.203.12@tcp:41: 00000004:00000024:0.0:1788509335.436715:0:9006:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788509335.436744:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:6167:x1875387774667264:12345-192.168.203.12@tcp:41: Request processed in 50us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509335.436750:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788509335.436762:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788509335.436768:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:0:x1875387774666880:12345-192.168.203.12@tcp:41: 00000004:00000024:0.0:1788509335.436800:0:9006:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788509335.436823:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:0:x1875387774666880:12345-192.168.203.12@tcp:41: Request processed in 55us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509335.436829:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:3.0:1788509335.438370:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509335.438380:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509335.440293:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509335.440421:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774667392 00000100:00100000:0.0:1788509335.440433:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774667392 00000100:00100000:0.0:1788509335.440524:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788509335.440536:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6167:x1875387774667392:12345-192.168.203.12@tcp:40: 00000100:00100000:0.0:1788509335.440669:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6167:x1875387774667392:12345-192.168.203.12@tcp:40: Request processed in 134us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509335.440677:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788509335.443298:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509335.443729:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774667776 00000100:00100000:3.0:1788509335.443742:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774667776 00000100:00100000:3.0:1788509335.444162:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788509335.444177:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6167:x1875387774667776:12345-192.168.203.12@tcp:900: 00000100:00100000:3.0:1788509335.444310:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6167:x1875387774667776:12345-192.168.203.12@tcp:900: Request processed in 137us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509335.444318:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788509335.446123:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509335.446297:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774667520 00000100:00100000:3.0:1788509335.446310:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774667520 00000100:00100000:3.0:1788509335.446365:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788509335.446376:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875387774667520:12345-192.168.203.12@tcp:8: 00000100:00100000:0.0:1788509335.446422:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509335.446472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509335.446507:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774667648 00000100:00100000:0.0:1788509335.446509:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774667904 00000100:00100000:0.0:1788509335.446515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774667904 00000100:00100000:2.0:1788509335.446523:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774667648 00000100:00100000:2.0:1788509335.446564:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788509335.446570:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1875387774667648:12345-192.168.203.12@tcp:8: 00010000:00080000:2.0:1788509335.446613:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1788509335.446666:0:8436:0:(genops.c:1385:class_connect()) connect: client d1c7a223-cc58-4f2c-be22-e37eba96eeae, cookie 0xe5156b86310dd867 00002000:00100000:2.0:1788509335.446683:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d1c7a223-cc58-4f2c-be22-e37eba96eeae/ffff8bcdb786f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788509335.446708:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788509335.446712:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:0.0:1788509335.446723:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2409:x1875387774667904:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788509335.446830:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2409:x1875387774667904:12345-192.168.203.12@tcp:400: Request processed in 107us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509335.446838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00010000:00080000:3.0:1788509335.447964:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1788509335.448000:0:8438:0:(genops.c:1385:class_connect()) connect: client d1c7a223-cc58-4f2c-be22-e37eba96eeae, cookie 0xe5156b86310dd86e 00002000:00100000:3.0:1788509335.448011:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d1c7a223-cc58-4f2c-be22-e37eba96eeae/ffff8bcc86044000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788509335.448034:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788509335.448611:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788509335.448655:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcc86042800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788509335.448738:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2406:x1875387774667520:12345-192.168.203.12@tcp:8: Request processed in 2362us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509335.448750:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00002000:00080000:2.0:1788509335.449841:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788509335.450141:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8bcdb786c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509335.450265:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2406:x1875387774667648:12345-192.168.203.12@tcp:8: Request processed in 3691us (3845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509335.450276:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788509335.451808:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509335.452204:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774668032 00000100:00100000:3.0:1788509335.452217:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774668032 00000100:00100000:3.0:1788509335.452531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788509335.452560:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6167:x1875387774668032:12345-192.168.203.12@tcp:33: 00000004:00080000:3.0:1788509335.484950:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32169us 00000004:00200000:3.0:1788509335.496655:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788509335.496768:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6167:x1875387774668032:12345-192.168.203.12@tcp:33: Request processed in 44209us (44965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509335.496779:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788509335.643290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509335.644534:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774668160 00000100:00100000:2.0:1788509335.644555:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774668160 00000100:00100000:2.0:1788509335.644677:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788509335.644688:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6211:x1875387774668160:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788509335.644707:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509335.647893:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509335.648220:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dd87c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509335.648233:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509335.648268:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509335.648316:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788509335.648320:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509335.648335:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509335.648363:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f7d expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509335.648382:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dd87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f7d expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509335.648397:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcda03cf900) 00010000:00010000:2.0:1788509335.648400:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788509335.648404:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227200, rc 0) 00000100:00100000:2.0:1788509335.648531:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:6211:x1875387774668160:12345-192.168.203.12@tcp:101: Request processed in 3845us (5248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509335.648549:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:2.0:1788509336.406598:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509337.430251:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509337.552337:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509337.552402:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774668288 00000100:00100000:3.0:1788509337.552417:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774668288 00000100:00100000:3.0:1788509337.552524:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788509337.552547:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:6263:x1875387774668288:12345-192.168.203.12@tcp:41: 00000100:00080000:2.0:1788509337.552579:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788509337.552605:0:9006:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788509337.552766:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:6263:x1875387774668288:12345-192.168.203.12@tcp:41: Request processed in 222us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509337.552776:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788509337.560689:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509337.560855:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774668416 00000100:00100000:0.0:1788509337.560877:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774668416 00000100:00100000:0.0:1788509337.561026:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788509337.561056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6263:x1875387774668416:12345-192.168.203.12@tcp:41: 00000004:00000024:0.0:1788509337.561107:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:2.0:1788509337.561140:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509337.561211:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6263:x1875387774668416:12345-192.168.203.12@tcp:41: Request processed in 157us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509337.561219:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788509337.565517:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509337.565625:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774668544 00000100:00100000:3.0:1788509337.565639:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774668544 00000100:00100000:3.0:1788509337.565737:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788509337.565750:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6263:x1875387774668544:12345-192.168.203.12@tcp:13: 00000100:00080000:2.0:1788509337.565786:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788509337.565795:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509337.565893:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6263:x1875387774668544:12345-192.168.203.12@tcp:13: Request processed in 146us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509337.565959:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788509337.568621:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509337.568775:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774668672 00000100:00100000:1.0:1788509337.568785:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774668672 00000100:00100000:1.0:1788509337.568968:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788509337.568985:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6263:x1875387774668672:12345-192.168.203.12@tcp:13: 00002000:00000024:1.0:1788509337.569029:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788509337.569078:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509337.569151:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:6263:x1875387774668672:12345-192.168.203.12@tcp:13: Request processed in 171us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509337.569159:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788509338.331678:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796733056:0@lo:41: 00000100:00100000:3.0:1788509338.331790:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509338.332309:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796733056 00000100:00100000:0.0:1788509338.332321:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796733056 00000100:00100000:0.0:1788509338.332399:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788509338.332411:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796733056:12345-0@lo:41: 00000004:00000024:0.0:1788509338.332456:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788509338.332536:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796733056:12345-0@lo:41: Request processed in 126us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509338.332544:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788509338.332608:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796733056:0@lo:41: 00010000:00010000:3.0:1788509338.454552:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509338.838163:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796733184:0@lo:41: 00000100:00100000:1.0:1788509338.838258:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509338.842225:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796733184 00000100:00100000:3.0:1788509338.842243:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796733184 00000100:00100000:3.0:1788509338.842312:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788509338.842323:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796733184:12345-0@lo:41: 00000004:00000024:3.0:1788509338.842371:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788509338.846329:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796733312:0@lo:400: 00000100:00100000:1.0:1788509338.846418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509338.848599:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796733184:12345-0@lo:41: Request processed in 6267us (10329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509338.848616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788509338.849187:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796733824:0@lo:400: 00000100:00100000:1.0:1788509338.849259:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509338.849286:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796734336:0@lo:400: 00000100:00100000:1.0:1788509338.849311:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509338.849347:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796734848:0@lo:400: 00000100:00100000:1.0:1788509338.849371:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509338.849401:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788509338.849409:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796733440:0@lo:400: 00000100:00100000:1.0:1788509338.849440:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509338.849463:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796733952:0@lo:13: 00000100:00100000:1.0:1788509338.849488:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509338.849508:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796734464:0@lo:400: 00000100:00100000:2.0:1788509338.850819:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796733312 00000100:00100000:2.0:1788509338.850837:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796733312 00000100:00100000:2.0:1788509338.850924:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788509338.850936:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796733312:12345-0@lo:400: 00000100:00100000:3.0:1788509338.851758:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796733824 00000100:00100000:3.0:1788509338.851768:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796733824 00000100:00100000:3.0:1788509338.851803:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788509338.851812:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796733824:12345-0@lo:400: 00000100:00100000:0.0:1788509338.851947:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796733184:0@lo:41: 00000100:00100000:0.0:1788509338.851995:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796733696:0@lo:400: 00000100:00100000:0.0:1788509338.852063:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509338.852107:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796733440 00000100:00100000:0.0:1788509338.852111:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796733440 00000100:00100000:0.0:1788509338.852144:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796733696 00000100:00100000:0.0:1788509338.852147:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796733696 00000100:00100000:0.0:1788509338.852169:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788509338.852176:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796733440:12345-0@lo:400: 00000100:00100000:0.0:1788509338.852213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796733440:12345-0@lo:400: Request processed in 37us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509338.852222:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788509338.852262:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788509338.852268:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796733696:12345-0@lo:400: 00000100:00100000:0.0:1788509338.852297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796733696:12345-0@lo:400: Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509338.852304:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788509338.852342:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796733696:0@lo:400: 00000100:00100000:0.0:1788509338.852350:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796734208:0@lo:400: 00000100:00100000:0.0:1788509338.852373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509338.852390:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796734208 00000100:00100000:0.0:1788509338.852393:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796734208 00000100:00100000:0.0:1788509338.852426:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788509338.852432:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796734208:12345-0@lo:400: 00000100:00100000:0.0:1788509338.852460:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796734208:12345-0@lo:400: Request processed in 28us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509338.852466:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788509338.852482:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788509338.852504:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c42680 x1875387796734208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509338.852514:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796734208:0@lo:400: 00000100:00100000:0.0:1788509338.852535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796734720:0@lo:400: 00000100:00100000:0.0:1788509338.852688:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509338.852711:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796734720 00000100:00100000:0.0:1788509338.852715:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796734720 00000100:00100000:0.0:1788509338.852744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788509338.852750:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796734720:12345-0@lo:400: 00000100:00100000:0.0:1788509338.852781:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796734720:12345-0@lo:400: Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509338.852795:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788509338.852812:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788509338.852829:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c43800 x1875387796734720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509338.852839:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796734720:0@lo:400: 00000100:00100000:0.0:1788509338.852949:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788509338.852957:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796733568:0@lo:400: 00000100:00100000:0.0:1788509338.852988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509338.853002:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796734080:0@lo:400: 00000100:00100000:0.0:1788509338.853025:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509338.853044:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796734080 00000100:00100000:0.0:1788509338.853048:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796734080 00000100:00100000:0.0:1788509338.853074:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788509338.853081:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796734080:12345-0@lo:400: 00000100:00100000:0.0:1788509338.853112:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796734080:12345-0@lo:400: Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509338.853119:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788509338.853136:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509338.853154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796734080:0@lo:400: 00000100:00100000:0.0:1788509338.853161:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796734592:0@lo:400: 00000100:00100000:0.0:1788509338.853185:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509338.853203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796734592 00000100:00100000:0.0:1788509338.853207:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796734592 00000100:00100000:0.0:1788509338.853232:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788509338.853238:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796734592:12345-0@lo:400: 00000100:00100000:0.0:1788509338.853277:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796734592:12345-0@lo:400: Request processed in 39us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509338.853284:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788509338.853306:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509338.853324:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796734592:0@lo:400: 00000100:00100000:0.0:1788509338.853331:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796735104:0@lo:13: 00000100:00100000:0.0:1788509338.853357:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509338.853554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509338.853602:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796734976:0@lo:400: 00000100:00100000:1.0:1788509338.853628:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509338.853663:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796733440:0@lo:400: 00000100:00100000:1.0:1788509338.853701:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796734336 00000100:00100000:1.0:1788509338.853706:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796734336 00000100:00100000:1.0:1788509338.853737:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796734848 00000100:00100000:1.0:1788509338.853740:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796734848 00000100:00100000:1.0:1788509338.853754:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796734464 00000100:00100000:1.0:1788509338.853757:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796734464 00000100:00100000:1.0:1788509338.853768:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796734976 00000100:00100000:1.0:1788509338.853771:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796734976 00000100:00100000:1.0:1788509338.853786:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788509338.853792:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796734336:12345-0@lo:400: 00000100:00100000:1.0:1788509338.853833:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796734336:12345-0@lo:400: Request processed in 41us (4520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509338.853838:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788509338.853881:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788509338.853887:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796734848:12345-0@lo:400: 00000100:00100000:1.0:1788509338.853947:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796734848:12345-0@lo:400: Request processed in 60us (4574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509338.853954:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788509338.853968:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509338.853974:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796734464:12345-0@lo:400: 00000100:00100000:1.0:1788509338.854002:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796734464:12345-0@lo:400: Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509338.854009:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509338.854022:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788509338.854028:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796734976:12345-0@lo:400: 00000100:00100000:1.0:1788509338.854054:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796734976:12345-0@lo:400: Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509338.854059:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788509338.854089:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796733952 00000100:00100000:1.0:1788509338.854094:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796733952 00000100:00100000:1.0:1788509338.854117:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796735104 00000100:00100000:1.0:1788509338.854121:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796735104 00000100:00100000:1.0:1788509338.854134:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788509338.854140:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796733952:12345-0@lo:13: 00002000:00000024:1.0:1788509338.854168:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509338.854204:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796733952:12345-0@lo:13: Request processed in 64us (4715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509338.854211:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788509338.854227:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788509338.854234:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875387796735104:12345-0@lo:13: 00002000:00000024:1.0:1788509338.854244:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509338.854280:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875387796735104:12345-0@lo:13: Request processed in 47us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509338.854287:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788509338.854325:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788509338.854335:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:1.0:1788509338.854453:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788509338.854457:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788509338.854478:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc870b4a80 x1875387796733952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509338.854499:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796733952:0@lo:13: 00010000:00080000:1.0:1788509338.854511:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c42a00 x1875387796734464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509338.854531:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796734464:0@lo:400: 00010000:00080000:1.0:1788509338.854541:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c43100 x1875387796734976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509338.854548:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796734976:0@lo:400: 00010000:00080000:1.0:1788509338.854558:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c41f80 x1875387796734336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509338.854565:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796734336:0@lo:400: 00010000:00080000:1.0:1788509338.854574:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c41880 x1875387796734848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509338.854582:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796734848:0@lo:400: 00000100:00100000:1.0:1788509338.854629:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796733568 00000100:00100000:1.0:1788509338.854633:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796733568 00000100:00100000:1.0:1788509338.854744:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788509338.854760:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796733568:12345-0@lo:400: 00000100:00100000:1.0:1788509338.854804:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796733568:12345-0@lo:400: Request processed in 45us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509338.854810:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788509338.855598:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796733312:12345-0@lo:400: Request processed in 4659us (9174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509338.855609:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788509338.855760:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796733312:0@lo:400: 00000100:00100000:0.0:1788509338.856019:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796733568:0@lo:400: 00010000:00080000:0.0:1788509338.856036:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87780e00 x1875387796735104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509338.856055:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796735104:0@lo:13: 00000100:00100000:3.0:1788509338.861694:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796733824:12345-0@lo:400: Request processed in 9868us (12419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509338.861715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788509338.862742:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796733824:0@lo:400: 00000001:00100000:3.0:1788509338.864262:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000001:00080000:3.0:1788509338.864279:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1788509338.864295:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788509339.350797:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509339.350832:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796735232:0@lo:13: 00000100:00100000:3.0:1788509339.350958:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509339.351174:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796735232 00000100:00100000:2.0:1788509339.351186:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796735232 00000100:00100000:2.0:1788509339.351254:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509339.351266:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796735232:12345-0@lo:13: 00002000:00000024:2.0:1788509339.351304:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509339.351357:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796735232:12345-0@lo:13: Request processed in 94us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509339.351365:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788509339.351496:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781c00 x1875387796735232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509339.351529:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796735232:0@lo:13: 00000100:00100000:1.0:1788509339.352311:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796735360:0@lo:13: 00000100:00100000:1.0:1788509339.352363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509339.352478:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796735360 00000100:00100000:0.0:1788509339.352484:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796735360 00000100:00100000:0.0:1788509339.352536:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788509339.352544:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796735360:12345-0@lo:13: 00002000:00000024:0.0:1788509339.352562:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509339.352611:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796735360:12345-0@lo:13: Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509339.352617:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788509339.352778:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc874daa00 x1875387796735360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509339.352794:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796735360:0@lo:13: 00010000:00010000:1.0:1788509339.478287:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788509339.866994:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000001:00100000:2.0:1788509339.869145:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00010000:00010000:2.0:1788509340.507662:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788509340.590143:0:10187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788509340.893329:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000100:00100000:1.0:1788509340.959124:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509340.959186:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509340.959227:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509340.959260:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509340.959295:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509340.959330:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774669056 00000100:00100000:1.0:1788509340.959343:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774669056 00000100:00100000:0.0:1788509340.959401:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774668800 00000100:00100000:0.0:1788509340.959407:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774668800 00000100:00100000:0.0:1788509340.959461:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:0.0:1788509340.959473:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2408:x1875387774668800:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788509340.959580:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2408:x1875387774668800:12345-192.168.203.12@tcp:400: Request processed in 109us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509340.959610:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:0.0:1788509340.959805:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774669312 00000100:00100000:0.0:1788509340.959810:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774669312 00000100:00100000:1.0:1788509340.960021:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774668928 00000100:00100000:1.0:1788509340.960026:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774668928 00000100:00100000:1.0:1788509340.960060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788509340.960069:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774669056:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788509340.960105:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774669184 00000100:00100000:0.0:1788509340.960111:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774669184 00000100:00100000:1.0:1788509340.960124:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774669056:12345-192.168.203.12@tcp:400: Request processed in 55us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509340.960142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788509340.960148:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788509340.960157:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774669312:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788509340.960181:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788509340.960196:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774669312:12345-192.168.203.12@tcp:400: Request processed in 35us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509340.960197:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774668928:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788509340.960211:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788509340.960229:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788509340.960240:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774668928:12345-192.168.203.12@tcp:400: Request processed in 49us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509340.960241:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774669184:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788509340.960255:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788509340.960277:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774669184:12345-192.168.203.12@tcp:400: Request processed in 41us (980us total) trans 0 rc 0/0 00000100:00080000:1.0:1788509340.960281:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509340.960287:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:1.0:1788509340.960288:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509340.960292:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788509340.960296:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788509341.527059:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509342.554806:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509343.449089:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796735488:0@lo:41: 00000100:00100000:1.0:1788509343.449194:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509343.449389:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796735488 00000100:00100000:2.0:1788509343.449400:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796735488 00000100:00100000:2.0:1788509343.449467:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788509343.449479:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796735488:12345-0@lo:41: 00000004:00000024:2.0:1788509343.449533:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788509343.449596:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796735488:12345-0@lo:41: Request processed in 118us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509343.449603:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788509343.449673:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796735488:0@lo:41: 00010000:00010000:3.0:1788509343.578240:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788509343.918741:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe510a9640 20000000:00000080:1.0:1788509343.918765:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bcc876c5c00 uarg=0000000000000000 20000000:01000000:1.0:1788509343.918881:0:10335:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788509343.918884:0:10335:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788509343.918887:0:10335:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788509343.918893:0:10335:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788509343.918958:0:10335:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788509343.919039:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788509343.919043:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788509343.920158:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788509343.920664:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788509343.920704:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788509343.920721:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788509343.920732:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788509343.920735:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788509343.921550:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788509343.921746:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788509343.921782:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788509343.921819:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788509343.921830:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788509343.921832:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788509343.922352:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788509343.922566:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788509343.922587:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788509343.922619:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788509343.922632:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788509343.922634:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788509343.923332:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788509343.923715:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788509343.923742:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788509343.923758:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788509343.923767:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788509343.923769:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788509343.924579:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788509343.924767:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788509343.925041:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788509343.925061:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:1.0:1788509343.925077:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788509343.925103:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925127:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd717 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925136:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd741 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925143:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd780 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925149:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd78e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925172:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd79c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925180:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925188:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd7db expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925272:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925280:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd828 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925292:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925301:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925310:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925363:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925383:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 9 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.925413:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c40700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796735616:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509343.925595:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925605:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 9 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.925614:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c42300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796735744:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509343.925647:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd828 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925656:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd828 expref: 23 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.925666:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796735872:0@lo:104: 00000100:00100000:1.0:1788509343.925714:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509343.925811:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.925822:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 23 pid: 6513 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.925830:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796736000:0@lo:104: 00000100:00100000:1.0:1788509343.925852:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509343.926457:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd7db expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.926467:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd7db expref: 23 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.926495:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796736128:0@lo:104: 00000100:00100000:1.0:1788509343.926524:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509343.926588:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796735872 00000100:00100000:3.0:1788509343.926599:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796735872 00000100:00100000:2.0:1788509343.926663:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796736000 00000100:00100000:2.0:1788509343.926668:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796736000 00000100:00100000:2.0:1788509343.926712:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788509343.926724:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:10335:x1875387796735872:12345-0@lo:104: 00010000:00010000:2.0:1788509343.926740:0:7471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509343.926948:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788509343.926959:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:10335:x1875387796736000:12345-0@lo:104: 00010000:00010000:0.0:1788509343.926969:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.927033:0:7471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788509343.927040:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:10335:x1875387796735872:12345-0@lo:104: Request processed in 318us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509343.927047:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788509343.927332:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509343.927341:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.927349:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509343.927354:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.927364:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788509343.927372:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509343.927379:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788509343.927446:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.927454:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509343.927474:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.927492:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8000/0xe5156b86310dd828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd82f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.927511:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509343.927524:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509343.927527:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509343.927543:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796736256:0@lo:103: 00010000:00010000:0.0:1788509343.927651:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509343.927657:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796736000:12345-0@lo:104: Request processed in 701us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509343.927665:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788509343.927683:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796736128 00000100:00100000:0.0:1788509343.927696:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796736128 00000100:00100000:0.0:1788509343.927726:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788509343.927733:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796736128:12345-0@lo:104: 00010000:00010000:0.0:1788509343.927741:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.927774:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788509343.927779:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796736128:12345-0@lo:104: Request processed in 47us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509343.927802:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788509343.927819:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509343.927823:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.927829:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509343.927832:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.927839:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509343.927845:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509343.927850:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788509343.928011:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509343.928067:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796736256 00000100:00100000:3.0:1788509343.928071:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796736256 00010000:00010000:3.0:1788509343.928562:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd828 expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509343.928593:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788509343.928602:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796736256:12345-0@lo:103: 00010000:00010000:3.0:1788509343.928616:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509343.928622:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd828 expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.928634:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd828 expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.928658:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509343.928698:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796736256:12345-0@lo:103: Request processed in 99us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.928705:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788509343.928774:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796736256:0@lo:103: 00010000:00010000:0.0:1788509343.929083:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929091:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509343.929114:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929132:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd7fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd805 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929147:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509343.929151:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929157:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8800 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509343.929161:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929169:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509343.929176:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509343.929182:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509343.929203:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929209:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509343.929228:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929234:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dd7db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929244:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.929252:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.929254:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.929261:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509343.929274:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796736512:0@lo:103: 00000100:00100000:0.0:1788509343.929314:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509343.929359:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796736512 00000100:00100000:0.0:1788509343.929365:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796736512 00010000:00010000:0.0:1788509343.929388:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd7db expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509343.929412:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788509343.929419:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796736512:12345-0@lo:103: 00010000:00010000:0.0:1788509343.929428:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509343.929432:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd7db expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929440:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd7db expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929455:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509343.929494:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796736512:12345-0@lo:103: Request processed in 66us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509343.929501:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788509343.929533:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796736512:0@lo:103: 00010000:00010000:0.0:1788509343.929592:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929604:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 23 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509343.929627:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796736640:0@lo:104: 00000100:00100000:0.0:1788509343.929656:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509343.929691:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788509343.929700:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796736640 00000100:00100000:0.0:1788509343.929704:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796736640 00000100:00100000:0.0:1788509343.929728:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788509343.929734:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796736640:12345-0@lo:104: 00010000:00010000:0.0:1788509343.929745:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.929774:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509343.929779:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796736640:12345-0@lo:104: Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.930005:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796736384:0@lo:103: 00000100:00100000:1.0:1788509343.930052:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.930095:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796736384 00000100:00100000:1.0:1788509343.930099:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796736384 00010000:00010000:1.0:1788509343.930119:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 24 pid: 6513 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.930139:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788509343.930145:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796736384:12345-0@lo:103: 00010000:00010000:1.0:1788509343.930153:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509343.930157:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 24 pid: 6513 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.930167:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 24 pid: 6513 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.930179:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509343.930206:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796736384:12345-0@lo:103: Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.930213:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788509343.930261:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796736384:0@lo:103: 00000100:00100000:0.0:1788509343.930397:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788509343.930441:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509343.930447:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930455:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509343.930459:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930468:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509343.930475:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509343.930504:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509343.930568:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930575:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509343.930594:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930602:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9000/0xe5156b86310dd7b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930614:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.930616:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.930618:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.930642:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd79c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930652:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd79c expref: 23 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509343.930663:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796736896:0@lo:104: 00000100:00100000:0.0:1788509343.930694:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509343.930718:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796736896 00000100:00100000:0.0:1788509343.930722:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796736896 00000100:00100000:0.0:1788509343.930746:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788509343.930752:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796736896:12345-0@lo:104: 00010000:00010000:0.0:1788509343.930761:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930885:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509343.930891:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796736896:12345-0@lo:104: Request processed in 139us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509343.930916:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788509343.930930:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509343.930935:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930942:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509343.930945:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.930953:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509343.930960:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509343.930965:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788509343.931016:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509343.931027:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796736768:0@lo:103: 00000100:00100000:1.0:1788509343.931054:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.931096:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796736768 00000100:00100000:1.0:1788509343.931100:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796736768 00010000:00010000:1.0:1788509343.931117:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 24 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.931137:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788509343.931143:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796736768:12345-0@lo:103: 00010000:00010000:1.0:1788509343.931152:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509343.931157:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 24 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.931166:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 24 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.931180:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509343.931206:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796736768:12345-0@lo:103: Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.931213:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788509343.931251:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796736768:0@lo:103: 00000100:00100000:2.0:1788509343.931425:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509343.931543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509343.931666:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774669440 00000100:00100000:1.0:1788509343.931671:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774669440 00010000:00010000:1.0:1788509343.931690:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 10 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.931717:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774669568 00000100:00100000:1.0:1788509343.931720:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774669568 00010000:00010000:1.0:1788509343.931731:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 11 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.931748:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788509343.931761:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:2407:x1875387774669440:12345-192.168.203.12@tcp:103: 00010000:00010000:1.0:1788509343.931772:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509343.931776:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 11 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.931920:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 11 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.931936:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509343.931982:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:2407:x1875387774669440:12345-192.168.203.12@tcp:103: Request processed in 222us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.931989:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788509343.932011:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1788509343.932017:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2407:x1875387774669568:12345-192.168.203.12@tcp:103: 00010000:00010000:1.0:1788509343.932025:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509343.932030:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 10 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.932040:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 10 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.932050:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509343.932067:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2407:x1875387774669568:12345-192.168.203.12@tcp:103: Request processed in 50us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.932073:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00010000:00010000:0.0:1788509343.932498:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.932508:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788509343.932549:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796737024:0@lo:103: 00000100:00100000:1.0:1788509343.932590:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509343.932659:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.932668:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92924000/0xe5156b86310dd79c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd7a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.932692:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.932694:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.932697:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.932733:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd78e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.932744:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd78e expref: 23 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509343.932755:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796737152:0@lo:104: 00000100:00100000:0.0:1788509343.932783:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509343.933081:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796737152 00000100:00100000:0.0:1788509343.933087:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796737152 00000100:00100000:0.0:1788509343.933121:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788509343.933127:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796737152:12345-0@lo:104: 00010000:00010000:0.0:1788509343.933140:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933180:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509343.933185:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796737152:12345-0@lo:104: Request processed in 59us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509343.933192:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788509343.933208:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509343.933212:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933219:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8e00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509343.933223:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933239:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509343.933247:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509343.933253:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509343.933446:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933453:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509343.933470:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933477:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd78e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933497:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.933499:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.933500:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.933529:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd780 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933538:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd780 expref: 23 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509343.933549:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796737408:0@lo:104: 00000100:00100000:0.0:1788509343.933578:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509343.933601:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796737408 00000100:00100000:0.0:1788509343.933611:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796737408 00000100:00100000:0.0:1788509343.933635:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788509343.933641:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796737408:12345-0@lo:104: 00010000:00010000:0.0:1788509343.933649:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933682:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509343.933687:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796737408:12345-0@lo:104: Request processed in 46us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509343.933693:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1788509343.933709:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509343.933712:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933718:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925e00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509343.933721:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933728:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509343.933734:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509343.933739:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509343.933754:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.933760:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509343.933774:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.933934:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796737536:0@lo:103: 00000100:00100000:1.0:1788509343.933967:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.934010:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796737024 00000100:00100000:1.0:1788509343.934014:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796737024 00010000:00010000:1.0:1788509343.934034:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd79c expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.934055:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796737536 00000100:00100000:1.0:1788509343.934057:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796737536 00010000:00010000:1.0:1788509343.934067:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd780 expref: 25 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.934083:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788509343.934089:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+25:3646:x1875387796737024:12345-0@lo:103: 00010000:00010000:1.0:1788509343.934099:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509343.934104:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd79c expref: 25 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.934114:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd79c expref: 25 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.934132:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509343.934153:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+25:3646:x1875387796737024:12345-0@lo:103: Request processed in 64us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.934159:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788509343.934185:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788509343.934191:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796737536:12345-0@lo:103: 00010000:00010000:1.0:1788509343.934198:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509343.934202:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd780 expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.934218:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd780 expref: 24 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.934226:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509343.934253:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796737536:12345-0@lo:103: Request processed in 62us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.934259:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788509343.934307:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796737280:0@lo:103: 00000100:00100000:1.0:1788509343.934330:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.934372:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796737024:0@lo:103: 00000100:00100000:1.0:1788509343.934396:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796737280 00000100:00100000:1.0:1788509343.934400:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796737280 00010000:00010000:1.0:1788509343.934413:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd78e expref: 24 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.934426:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788509343.934431:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796737280:12345-0@lo:103: 00010000:00010000:1.0:1788509343.934438:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509343.934441:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd78e expref: 24 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.934448:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd78e expref: 24 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.934456:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509343.934480:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796737280:12345-0@lo:103: Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.934508:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788509343.934537:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796737280:0@lo:103: 00000100:00100000:1.0:1788509343.934555:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796737536:0@lo:103: 00010000:00010000:1.0:1788509343.934727:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd741 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.934738:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd741 expref: 23 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.934747:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796737664:0@lo:104: 00000100:00100000:1.0:1788509343.934772:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509343.934952:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd717 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.934961:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd717 expref: 23 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.934968:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796737792:0@lo:104: 00000100:00100000:1.0:1788509343.934989:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.935001:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bd80 going to sleep for 11 seconds 00010000:00010000:1.0:1788509343.935019:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590b800/0xe5156b86310dd844 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f14 expref: 9 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935033:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c40700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796735616:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509343.935044:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd83d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f0d expref: 8 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935065:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c42300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796735744:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509343.935078:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd82f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd828 expref: 23 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935086:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796735872:0@lo:104: 00010000:00010000:1.0:1788509343.935095:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd7fe expref: 22 pid: 6513 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935103:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796736000:0@lo:104: 00010000:00010000:1.0:1788509343.935112:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd7e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd7db expref: 21 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935119:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796736128:0@lo:104: 00010000:00010000:1.0:1788509343.935129:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd7bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd7b8 expref: 20 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935139:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796736640:0@lo:104: 00010000:00010000:1.0:1788509343.935148:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd79c expref: 19 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935156:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796736896:0@lo:104: 00010000:00010000:1.0:1788509343.935166:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd78e expref: 18 pid: 6515 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935173:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796737152:0@lo:104: 00010000:00010000:1.0:1788509343.935185:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd780 expref: 17 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.935200:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796737408:0@lo:104: 00000100:00100000:3.0:1788509343.935267:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796737664 00000100:00100000:3.0:1788509343.935306:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796737664 00000100:00100000:3.0:1788509343.935331:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796737792 00000100:00100000:3.0:1788509343.935339:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796737792 00000100:00100000:3.0:1788509343.935354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509343.935361:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:10335:x1875387796737664:12345-0@lo:104: 00010000:00010000:3.0:1788509343.935380:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.935449:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509343.935454:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:10335:x1875387796737664:12345-0@lo:104: Request processed in 95us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.935461:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509343.935476:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788509343.935492:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796737792:12345-0@lo:104: 00010000:00010000:3.0:1788509343.935500:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509343.935526:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788509343.935531:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:10335:x1875387796737792:12345-0@lo:104: Request processed in 50us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.935537:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788509343.935585:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796737664:0@lo:104: 00000100:00100000:1.0:1788509343.935592:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875387796737792:0@lo:104: 00010000:00010000:1.0:1788509343.935631:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.935714:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92925e00/0xe5156b86310dd780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd787 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.935730:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509343.935735:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.935741:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925200 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509343.935745:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.935754:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509343.935760:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509343.935766:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509343.936026:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.936035:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509343.936061:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.936069:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd748 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.936079:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509343.936090:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.936096:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509343.936100:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.936107:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509343.936114:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509343.936120:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788509343.936156:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796737920:0@lo:103: 00000100:00100000:1.0:1788509343.936200:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.936257:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796737920 00000100:00100000:1.0:1788509343.936262:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796737920 00010000:00010000:1.0:1788509343.936284:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd741 expref: 17 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.936306:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788509343.936312:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:3645:x1875387796737920:12345-0@lo:103: 00010000:00010000:1.0:1788509343.936324:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509343.936329:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd741 expref: 17 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.936340:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd741 expref: 17 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.936354:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590a400/0xe5156b86310dd748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd741 expref: 17 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.936366:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509343.936395:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3645:x1875387796737920:12345-0@lo:103: Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.936408:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788509343.936448:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796737920:0@lo:103: 00010000:00010000:0.0:1788509343.936606:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.936613:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788509343.936648:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796738048:0@lo:103: 00000100:00100000:1.0:1788509343.936677:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509343.936705:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796738048 00000100:00100000:2.0:1788509343.936712:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796738048 00010000:00010000:0.0:1788509343.936721:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.936731:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd71e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.936737:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd717 expref: 16 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509343.936749:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.936752:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509343.936755:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509343.936764:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788509343.936773:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:3646:x1875387796738048:12345-0@lo:103: 00010000:00010000:0.0:1788509343.936777:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509343.936782:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509343.936788:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd717 expref: 16 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.936798:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd717 expref: 16 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.936809:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226800/0xe5156b86310dd71e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd717 expref: 16 pid: 6514 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.936822:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.936832:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.936945:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.936953:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.937154:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.937167:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.937173:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9e00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509343.937178:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.937185:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.937204:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509343.937215:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509343.937375:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:3646:x1875387796738048:12345-0@lo:103: Request processed in 602us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509343.937382:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788509343.937516:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796738048:0@lo:103: 00010000:00010000:1.0:1788509343.937779:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.937968:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509343.937975:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310dd883 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509343.959246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796738176:0@lo:13: 00000100:00100000:1.0:1788509343.959339:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.959388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796738688:0@lo:400: 00000100:00100000:1.0:1788509343.959415:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.959432:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796739200:0@lo:400: 00000100:00100000:1.0:1788509343.959454:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.959471:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796739712:0@lo:400: 00000100:00100000:1.0:1788509343.959504:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.959531:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788509343.959537:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796738560:0@lo:400: 00000100:00100000:1.0:1788509343.959561:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.959587:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796739072:0@lo:400: 00000100:00100000:1.0:1788509343.959607:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.959636:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796739584:0@lo:400: 00000100:00100000:1.0:1788509343.959658:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.959691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796738304:0@lo:13: 00000100:00100000:1.0:1788509343.959714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.959733:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796738816:0@lo:400: 00000100:00100000:1.0:1788509343.961051:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.961096:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796739328:0@lo:400: 00000100:00100000:1.0:1788509343.961152:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.961179:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796739840:0@lo:400: 00000100:00100000:1.0:1788509343.961204:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.961300:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788509343.961308:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796738432:0@lo:400: 00000100:00100000:1.0:1788509343.961335:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.961358:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796738944:0@lo:400: 00000100:00100000:1.0:1788509343.961379:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509343.961642:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796738560 00000100:00100000:3.0:1788509343.961653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796738560 00000100:00100000:3.0:1788509343.961718:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796738816 00000100:00100000:3.0:1788509343.961722:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796738816 00000100:00100000:3.0:1788509343.961741:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788509343.961750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796738560:12345-0@lo:400: 00000100:00100000:1.0:1788509343.962470:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796739456:0@lo:400: 00000100:00100000:1.0:1788509343.962534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509343.962557:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509343.962569:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796739968:0@lo:41: 00000100:00100000:1.0:1788509343.962595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509343.963122:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796739968 00000100:00100000:2.0:1788509343.963130:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796739968 00000100:00100000:2.0:1788509343.963172:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788509343.963182:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796738816:12345-0@lo:400: 00000100:00100000:2.0:1788509343.963248:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796738816:12345-0@lo:400: Request processed in 68us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509343.963257:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788509343.963275:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788509343.963282:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796739968:12345-0@lo:41: 00000004:00000024:2.0:1788509343.963314:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788509343.963349:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796739968:12345-0@lo:41: Request processed in 68us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509343.963367:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788509343.963473:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796738560:12345-0@lo:400: Request processed in 1724us (3911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.963491:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788509343.963986:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796738176 00000100:00100000:3.0:1788509343.964003:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796738176 00000100:00100000:3.0:1788509343.964050:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796738304 00000100:00100000:3.0:1788509343.964054:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796738304 00000100:00100000:3.0:1788509343.964073:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788509343.964078:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796738176:12345-0@lo:13: 00002000:00000024:3.0:1788509343.964104:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509343.964151:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796738176:12345-0@lo:13: Request processed in 72us (4812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.964158:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788509343.964169:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788509343.964174:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796738304:12345-0@lo:13: 00002000:00000024:3.0:1788509343.964186:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509343.964210:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796738304:12345-0@lo:13: Request processed in 36us (4495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.964215:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788509343.964234:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796738688 00000100:00100000:3.0:1788509343.964238:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796738688 00000100:00100000:3.0:1788509343.964256:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796739072 00000100:00100000:3.0:1788509343.964259:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796739072 00000100:00100000:3.0:1788509343.964270:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796739584 00000100:00100000:3.0:1788509343.964273:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796739584 00000100:00100000:3.0:1788509343.964286:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796738432 00000100:00100000:3.0:1788509343.964289:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796738432 00000100:00100000:3.0:1788509343.964300:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796738944 00000100:00100000:3.0:1788509343.964303:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796738944 00000100:00100000:3.0:1788509343.964317:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796739456 00000100:00100000:3.0:1788509343.964320:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796739456 00000100:00100000:3.0:1788509343.964334:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788509343.964340:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796738688:12345-0@lo:400: 00000100:00100000:3.0:1788509343.964377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796738688:12345-0@lo:400: Request processed in 36us (4960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509343.964987:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796739968:0@lo:41: 00010000:00080000:2.0:1788509343.965009:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87355500 x1875387796738304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509343.965021:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788509343.965041:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796738304:0@lo:13: 00000100:00100000:2.0:1788509343.965055:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796738816:0@lo:400: 00000100:00100000:3.0:1788509343.965357:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788509343.965381:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788509343.965932:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796739072:12345-0@lo:400: 00000100:00100000:3.0:1788509343.966009:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796739072:12345-0@lo:400: Request processed in 621us (6400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.966016:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788509343.966033:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788509343.966041:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796739584:12345-0@lo:400: 00000100:00100000:3.0:1788509343.966071:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796739584:12345-0@lo:400: Request processed in 32us (6413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.966077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788509343.966088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788509343.966094:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796738432:12345-0@lo:400: 00000100:00100000:3.0:1788509343.966132:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796738432:12345-0@lo:400: Request processed in 38us (4795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.966137:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788509343.966148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788509343.966155:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796738944:12345-0@lo:400: 00000100:00100000:3.0:1788509343.966183:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796738944:12345-0@lo:400: Request processed in 29us (4804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.966189:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788509343.966199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788509343.966205:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796739456:12345-0@lo:400: 00000100:00100000:3.0:1788509343.966232:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796739456:12345-0@lo:400: Request processed in 28us (3698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509343.966251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788509343.966282:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796739200 00000100:00100000:3.0:1788509343.966289:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796739200 00000100:00100000:3.0:1788509343.966324:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796739712 00000100:00100000:3.0:1788509343.966327:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796739712 00000100:00100000:3.0:1788509343.966337:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796739328 00000100:00100000:3.0:1788509343.966340:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796739328 00000100:00100000:3.0:1788509343.966351:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796739840 00000100:00100000:3.0:1788509343.966354:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796739840 00000100:00100000:3.0:1788509343.966366:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509343.966372:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796739200:12345-0@lo:400: 00000100:00100000:0.0:1788509343.967234:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796738432:0@lo:400: 00000100:00100000:0.0:1788509343.967254:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796738944:0@lo:400: 00000100:00100000:0.0:1788509343.967285:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796739456:0@lo:400: 00000100:00100000:1.0:1788509343.970877:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788509343.970918:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796739712:12345-0@lo:400: 00000100:00100000:1.0:1788509343.971044:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796739712:12345-0@lo:400: Request processed in 151us (11538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.971053:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788509343.971089:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788509343.971098:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796739328:12345-0@lo:400: 00000100:00100000:1.0:1788509343.971138:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796739328:12345-0@lo:400: Request processed in 42us (9993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.971145:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788509343.971155:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788509343.971163:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796739840:12345-0@lo:400: 00000100:00100000:1.0:1788509343.971193:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796739840:12345-0@lo:400: Request processed in 32us (9989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509343.971199:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788509343.971227:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509343.971235:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509343.971238:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509343.971242:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509343.971316:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796738560:0@lo:400: 00010000:00080000:1.0:1788509343.971336:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87355f80 x1875387796739072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509343.971348:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796739072:0@lo:400: 00010000:00080000:1.0:1788509343.971360:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87355880 x1875387796739584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509343.971369:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796739584:0@lo:400: 00010000:00080000:1.0:1788509343.971381:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87357100 x1875387796738176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509343.971388:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788509343.971415:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796738176:0@lo:13: 00000100:00100000:1.0:1788509343.971436:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796738688:0@lo:400: 00010000:00080000:1.0:1788509343.971445:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87354000 x1875387796739712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509343.971453:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796739712:0@lo:400: 00010000:00080000:0.0:1788509343.972041:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356300 x1875387796739328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509343.972053:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796739328:0@lo:400: 00010000:00080000:0.0:1788509343.972066:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c42680 x1875387796739840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509343.972074:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796739840:0@lo:400: 00000100:00100000:3.0:1788509343.973374:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796739200:12345-0@lo:400: Request processed in 6993us (13910us total) trans 0 rc 0/0 00010000:00080000:1.0:1788509343.973498:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356a00 x1875387796739200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509343.973515:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796739200:0@lo:400: 00000100:00100000:3.0:1788509343.973566:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788509344.107363:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509344.107801:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774669696 00000100:00100000:3.0:1788509344.108024:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774669696 00000100:00100000:3.0:1788509344.108091:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:3.0:1788509344.108102:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+8:6182:x1875387774669696:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1788509344.108122:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509344.108148:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd88a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509344.108184:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd88a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f84 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509344.108197:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd88a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f84 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509344.108208:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924c00, rc 0) 00000100:00100000:3.0:1788509344.108304:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6182:x1875387774669696:12345-192.168.203.12@tcp:101: Request processed in 203us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509344.108311:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:1.0:1788509344.116692:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509344.118742:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774669824 00000100:00100000:2.0:1788509344.118762:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774669824 00000100:00100000:2.0:1788509344.119169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:2.0:1788509344.119182:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6182:x1875387774669824:12345-192.168.203.12@tcp:501: 00000100:00100000:2.0:1788509344.119407:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6182:x1875387774669824:12345-192.168.203.12@tcp:501: Request processed in 226us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509344.119415:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:3.0:1788509344.122184:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509344.122316:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774669952 00000100:00100000:0.0:1788509344.122329:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774669952 00000100:00100000:0.0:1788509344.122396:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:0.0:1788509344.122407:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6182:x1875387774669952:12345-192.168.203.12@tcp:503: 00000100:00100000:0.0:1788509344.122602:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6182:x1875387774669952:12345-192.168.203.12@tcp:503: Request processed in 196us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509344.122610:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:1.0:1788509344.128273:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509344.128478:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774670080 00000100:00100000:2.0:1788509344.128500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774670080 00000100:00100000:2.0:1788509344.128573:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:2.0:1788509344.128586:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6657:x1875387774670080:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1788509344.128790:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6657:x1875387774670080:12345-192.168.203.12@tcp:502: Request processed in 206us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509344.128808:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:1.0:1788509344.133095:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509344.133179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774670208 00000100:00100000:3.0:1788509344.133194:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774670208 00000100:00100000:3.0:1788509344.133266:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:3.0:1788509344.133279:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6657:x1875387774670208:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788509344.133518:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6657:x1875387774670208:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 240us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509344.133528:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:3.0:1788509344.144071:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509344.144650:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774670336 00000100:00100000:0.0:1788509344.144665:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774670336 00000100:00100000:0.0:1788509344.144745:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:0.0:1788509344.144758:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6182:x1875387774670336:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509344.144780:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509344.144825:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f8b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509344.144863:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f8b expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509344.144945:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f8b expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509344.144958:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590ba00, rc 0) 00000100:00100000:0.0:1788509344.145029:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6182:x1875387774670336:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 273us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509344.145035:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:1.0:1788509344.148000:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509344.148113:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774670464 00000100:00100000:3.0:1788509344.148126:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774670464 00000100:00100000:3.0:1788509344.148198:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:3.0:1788509344.148210:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6182:x1875387774670464:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509344.148380:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6182:x1875387774670464:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 171us (396us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788509344.148390:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:3.0:1788509344.471399:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796740096:0@lo:13: 00000100:00100000:3.0:1788509344.471474:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509344.471643:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796740096 00000100:00100000:2.0:1788509344.471652:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796740096 00000100:00100000:2.0:1788509344.471723:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788509344.471731:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796740096:12345-0@lo:13: 00002000:00000024:2.0:1788509344.471762:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509344.472625:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796740224:0@lo:13: 00000100:00100000:1.0:1788509344.472701:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509344.472725:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796740096:12345-0@lo:13: Request processed in 988us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509344.472737:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788509344.472768:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796740224 00000100:00100000:2.0:1788509344.472774:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796740224 00010000:00080000:3.0:1788509344.472953:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87780e00 x1875387796740096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509344.472975:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796740096:0@lo:13: 00000100:00100000:2.0:1788509344.473152:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788509344.473164:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796740224:12345-0@lo:13: 00002000:00000024:2.0:1788509344.473182:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509344.473241:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796740224:12345-0@lo:13: Request processed in 82us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509344.473248:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788509344.473379:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913e7b80 x1875387796740224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509344.473412:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796740224:0@lo:13: 00010000:00010000:0.0:1788509344.600280:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509345.622397:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788509345.688106:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788509345.688117:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcdb59c5000 from 48 10000000:01000000:0.0:1788509345.688123:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788509345.688182:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.688197:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.688211:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509345.688239:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796740352:0@lo:101: 00000100:00100000:0.0:1788509345.688340:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.688409:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.695803:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796740352 00000100:00100000:3.0:1788509345.696485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796740352 00000100:00100000:3.0:1788509345.696636:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788509345.696649:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+15:6517:x1875387796740352:12345-0@lo:101: 00010000:00010000:3.0:1788509345.696671:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509345.696695:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd89f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd898 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.697251:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd89f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd898 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.697270:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd89f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd898 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.697282:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924a00, rc 0) 00000100:00100000:3.0:1788509345.697401:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796740352:12345-0@lo:101: Request processed in 754us (9060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.697409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788509345.697546:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796740352:0@lo:101: 00010000:00010000:2.0:1788509345.697570:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509345.697580:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509345.697678:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796740480:0@lo:501: 00000100:00100000:2.0:1788509345.697733:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509345.707214:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb473ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.707624:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796740480 00000100:00100000:0.0:1788509345.707662:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796740480 00000100:00100000:0.0:1788509345.707764:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788509345.707777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796740480:12345-0@lo:501: 00000100:00100000:0.0:1788509345.708266:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796740480:12345-0@lo:501: Request processed in 490us (10531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.708276:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788509345.712032:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796740480:0@lo:501: 00000100:00100000:2.0:1788509345.712132:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796740608:0@lo:503: 00000100:00100000:2.0:1788509345.712252:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509345.712305:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb473ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.714656:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796740608 00000100:00100000:0.0:1788509345.714675:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796740608 00000100:00100000:0.0:1788509345.714960:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788509345.714974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796740608:12345-0@lo:503: 00000100:00100000:0.0:1788509345.715215:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796740608:12345-0@lo:503: Request processed in 243us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.715224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788509345.715311:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796740608:0@lo:503: 00000100:00100000:0.0:1788509345.719218:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10362:1875387796740736:0@lo:502: 00000100:00100000:0.0:1788509345.719339:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.719398:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.719506:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796740736 00000100:00100000:1.0:1788509345.719515:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796740736 00000100:00100000:1.0:1788509345.719576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788509345.719586:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:10362:x1875387796740736:12345-0@lo:502: 00000100:00100000:1.0:1788509345.720059:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:10362:x1875387796740736:12345-0@lo:502: Request processed in 462us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509345.720068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788509345.720243:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10362:1875387796740736:0@lo:502: 00000100:00100000:0.0:1788509345.720301:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10362:1875387796740864:0@lo:502: 00000100:00100000:0.0:1788509345.720343:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.720368:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.720531:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796740864 00000100:00100000:3.0:1788509345.720536:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796740864 00000100:00100000:3.0:1788509345.720579:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788509345.720587:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:10362:x1875387796740864:12345-0@lo:502: 00000100:00100000:3.0:1788509345.720689:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:10362:x1875387796740864:12345-0@lo:502: Request processed in 102us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.720695:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788509345.727609:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10362:1875387796740864:0@lo:502: 00000040:00080000:0.0:1788509345.727678:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788509345.728013:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788509345.728045:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509345.728061:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.728094:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509345.728107:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788509345.728110:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788509345.728113:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788509345.728168:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.728178:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.728189:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509345.728215:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796740992:0@lo:101: 00000100:00100000:3.0:1788509345.728301:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.728353:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.728378:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796740992 00000100:00100000:3.0:1788509345.728385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796740992 00000100:00100000:3.0:1788509345.728450:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788509345.728460:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+16:6517:x1875387796740992:12345-0@lo:101: 00010000:00010000:3.0:1788509345.728491:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509345.728509:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92925800/0xe5156b86310dd8ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd8a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.728537:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92925800/0xe5156b86310dd8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd8a6 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.728563:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92925800/0xe5156b86310dd8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd8a6 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.728573:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92925800, rc 0) 00000100:00100000:3.0:1788509345.728621:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796740992:12345-0@lo:101: Request processed in 160us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.728628:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788509345.728671:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796740992:0@lo:101: 00010000:00010000:3.0:1788509345.728685:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.728695:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509345.728787:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741120:0@lo:501: 00000100:00100000:3.0:1788509345.729019:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.729042:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.729054:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796741120 00000100:00100000:3.0:1788509345.729058:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796741120 00000100:00100000:3.0:1788509345.729077:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788509345.729083:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796741120:12345-0@lo:501: 00000100:00100000:3.0:1788509345.729222:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796741120:12345-0@lo:501: Request processed in 138us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.729229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788509345.729260:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741120:0@lo:501: 00000100:00100000:3.0:1788509345.729290:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741248:0@lo:503: 00000100:00100000:3.0:1788509345.729337:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.729350:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.729361:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796741248 00000100:00100000:3.0:1788509345.729364:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796741248 00000100:00100000:3.0:1788509345.729381:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788509345.729386:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796741248:12345-0@lo:503: 00000100:00100000:3.0:1788509345.729485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796741248:12345-0@lo:503: Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.729492:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788509345.729530:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741248:0@lo:503: 00000100:00100000:1.0:1788509345.748019:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10363:1875387796741376:0@lo:502: 00000100:00100000:1.0:1788509345.748144:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.748205:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.748344:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796741376 00000100:00100000:3.0:1788509345.748354:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796741376 00000100:00100000:3.0:1788509345.748416:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788509345.748427:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:10363:x1875387796741376:12345-0@lo:502: 00000100:00100000:3.0:1788509345.748608:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:10363:x1875387796741376:12345-0@lo:502: Request processed in 182us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.748628:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788509345.749129:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10363:1875387796741376:0@lo:502: 00000020:01000000:1.0:1788509345.749177:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509345.749198:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509345.749201:0:10363:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788509345.749207:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788509345.749240:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10363:1875387796741504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509345.749288:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.749325:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.749593:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796741504 00000100:00100000:0.0:1788509345.749600:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796741504 00000100:00100000:0.0:1788509345.749662:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788509345.749670:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:10363:x1875387796741504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.749781:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:10363:x1875387796741504:12345-0@lo:502:llog_process_th.0 Request processed in 111us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.749788:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788509345.752376:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10363:1875387796741504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509345.752425:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509345.752436:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509345.752438:0:10363:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788509345.752443:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788509345.761486:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788509345.761538:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788509345.761552:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.761566:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509345.761577:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788509345.761580:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd913e8000 from 48 10000000:01000000:3.0:1788509345.761584:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509345.761653:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.761662:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.761675:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509345.761705:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.761792:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.761851:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea300 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.764684:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796741632 00000100:00100000:1.0:1788509345.764705:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796741632 00000100:00100000:1.0:1788509345.764799:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788509345.764812:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+17:6517:x1875387796741632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509345.764837:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509345.764863:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9a00/0xe5156b86310dd8bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd8b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.764917:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9a00/0xe5156b86310dd8bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd8b4 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.764932:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9a00/0xe5156b86310dd8bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd8b4 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.764942:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9a00, rc 0) 00000100:00100000:1.0:1788509345.765054:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796741632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509345.765074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788509345.765166:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509345.765188:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.765199:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509345.765299:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.765344:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.765370:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.765387:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796741760 00000100:00100000:1.0:1788509345.765390:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796741760 00000100:00100000:1.0:1788509345.765415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788509345.765422:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796741760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.765580:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796741760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509345.765587:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788509345.765619:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.765650:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.765693:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.765708:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.765818:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796741888 00000100:00100000:1.0:1788509345.765823:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796741888 00000100:00100000:1.0:1788509345.765842:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788509345.765855:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796741888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.765963:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796741888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509345.765969:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788509345.766016:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796741888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.766245:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10365:1875387796742016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509345.766577:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.766607:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.767040:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796742016 00000100:00100000:0.0:1788509345.767047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796742016 00000100:00100000:0.0:1788509345.767088:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788509345.767097:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:10365:x1875387796742016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.767228:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:10365:x1875387796742016:12345-0@lo:502:llog_process_th.0 Request processed in 132us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.767235:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788509345.767789:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10365:1875387796742016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509345.768101:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10365:1875387796742144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509345.768163:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.768197:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.768252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796742144 00000100:00100000:0.0:1788509345.768258:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796742144 00000100:00100000:0.0:1788509345.768301:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788509345.768309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:10365:x1875387796742144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.768421:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:10365:x1875387796742144:12345-0@lo:502:llog_process_th.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.768428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788509345.768547:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10365:1875387796742144:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788509345.768567:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788509345.769016:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788509345.769043:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788509345.769054:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.769067:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509345.769092:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788509345.769095:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788509345.769099:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788509345.769133:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.769141:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.769151:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509345.769169:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796742272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.769218:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.769261:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767900 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.769322:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796742272 00000100:00100000:3.0:1788509345.769329:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796742272 00000100:00100000:3.0:1788509345.769375:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788509345.769384:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+18:6517:x1875387796742272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509345.769396:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509345.769411:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd8c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd8c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.769438:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd8c2 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.769451:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd8c2 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.769460:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924800, rc 0) 00000100:00100000:3.0:1788509345.769512:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796742272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.769518:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788509345.769607:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796742272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509345.769634:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.769643:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509345.769703:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796742400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.769744:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.769764:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767900 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.769778:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796742400 00000100:00100000:0.0:1788509345.769782:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796742400 00000100:00100000:0.0:1788509345.770062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788509345.770071:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796742400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.770211:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796742400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.770218:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788509345.775118:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796742400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509345.775205:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796742528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788509345.775298:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.776032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796742528 00000100:00100000:3.0:1788509345.776041:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796742528 00000100:00100000:2.0:1788509345.776137:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb473e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788509345.776200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788509345.776209:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796742528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788509345.776355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796742528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509345.776364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788509345.776412:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796742528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.777412:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10366:1875387796742656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.777497:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.777542:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509345.777592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796742656 00000100:00100000:2.0:1788509345.777599:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796742656 00000100:00100000:2.0:1788509345.777657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788509345.777667:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:10366:x1875387796742656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788509345.777797:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:10366:x1875387796742656:12345-0@lo:502:llog_process_th.0 Request processed in 131us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509345.777819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788509345.778225:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10366:1875387796742656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788509345.778261:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509345.778274:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509345.778277:0:10366:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788509345.778284:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788509345.778309:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10366:1875387796742784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.778351:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.778380:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509345.778503:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796742784 00000100:00100000:2.0:1788509345.778508:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796742784 00000100:00100000:2.0:1788509345.778545:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788509345.778553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:10366:x1875387796742784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788509345.778643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:10366:x1875387796742784:12345-0@lo:502:llog_process_th.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509345.778657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788509345.778829:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10366:1875387796742784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788509345.778847:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509345.778851:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509345.778853:0:10366:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788509345.778857:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788509345.779250:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788509345.779275:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788509345.779288:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509345.779301:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509345.779312:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788509345.779315:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcdbbf0f800 from 48 10000000:01000000:2.0:1788509345.779318:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788509345.779355:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509345.779364:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509345.779374:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509345.779391:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796742912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788509345.779432:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509345.779468:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9820af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.780109:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796742912 00000100:00100000:3.0:1788509345.780119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796742912 00000100:00100000:3.0:1788509345.780171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788509345.780181:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:6517:x1875387796742912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509345.780195:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509345.780212:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92925e00/0xe5156b86310dd8d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd8d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.780240:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92925e00/0xe5156b86310dd8d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd8d0 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.780271:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92925e00/0xe5156b86310dd8d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd8d0 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.780281:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92925e00, rc 0) 00000100:00100000:3.0:1788509345.780335:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796742912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.780342:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788509345.780445:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796742912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509345.780463:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509345.780496:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509345.780566:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509345.780597:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509345.780635:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9820af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.780783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796743040 00000100:00100000:3.0:1788509345.780788:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796743040 00000100:00100000:3.0:1788509345.780997:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788509345.781005:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796743040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.781155:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796743040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.781162:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788509345.785163:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509345.785250:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788509345.785352:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509345.785511:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9820af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.789316:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796743168 00000100:00100000:3.0:1788509345.789337:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796743168 00000100:00100000:3.0:1788509345.790167:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788509345.790182:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796743168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.790405:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796743168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (5053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.790414:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788509345.792004:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.792784:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10367:1875387796743296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.792948:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.793023:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.793178:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796743296 00000100:00100000:0.0:1788509345.793187:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796743296 00000100:00100000:0.0:1788509345.793362:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788509345.793373:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:10367:x1875387796743296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.793553:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:10367:x1875387796743296:12345-0@lo:502:llog_process_th.0 Request processed in 181us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.793562:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788509345.794109:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10367:1875387796743296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.794172:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10367:1875387796743424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.794227:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.794265:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea180 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.794310:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796743424 00000100:00100000:1.0:1788509345.794317:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796743424 00000100:00100000:1.0:1788509345.794359:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788509345.794368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:10367:x1875387796743424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509345.794481:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:10367:x1875387796743424:12345-0@lo:502:llog_process_th.0 Request processed in 114us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509345.794489:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788509345.794691:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10367:1875387796743424:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788509345.794720:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788509345.794984:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788509345.795011:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788509345.795024:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.795045:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509345.795056:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788509345.795059:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788509345.795063:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788509345.795098:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.795107:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.795117:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509345.795134:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.795172:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.795197:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.795369:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796743552 00000100:00100000:3.0:1788509345.795376:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796743552 00000100:00100000:3.0:1788509345.795416:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788509345.795423:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796743552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509345.795433:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509345.795448:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd8e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd8de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.795485:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd8de expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.795497:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd8de expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.795508:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924000, rc 0) 00000100:00100000:3.0:1788509345.795544:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796743552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.795550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788509345.795620:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509345.795646:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.795657:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509345.795729:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.795756:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.795799:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.796008:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796743680 00000100:00100000:3.0:1788509345.796013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796743680 00000100:00100000:3.0:1788509345.796050:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788509345.796055:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796743680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.796195:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796743680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.796202:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788509345.796289:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.796320:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.796358:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509345.796388:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.796404:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796743808 00000100:00100000:1.0:1788509345.796408:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796743808 00000100:00100000:1.0:1788509345.796438:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788509345.796445:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796743808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.796540:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796743808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509345.796547:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788509345.796603:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796743808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.800576:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10368:1875387796743936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.800693:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.800840:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767180 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.802368:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796743936 00000100:00100000:1.0:1788509345.802382:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796743936 00000100:00100000:1.0:1788509345.802465:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788509345.802485:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10368:x1875387796743936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509345.803163:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10368:x1875387796743936:12345-0@lo:502:llog_process_th.0 Request processed in 678us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509345.803173:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788509345.807669:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10368:1875387796743936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509345.807755:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509345.807769:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509345.807772:0:10368:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788509345.807781:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788509345.807831:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10368:1875387796744064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.807949:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.808005:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796744064 00000100:00100000:0.0:1788509345.808006:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.808014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796744064 00000100:00100000:3.0:1788509345.808085:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788509345.808096:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10368:x1875387796744064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.808267:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10368:x1875387796744064:12345-0@lo:502:llog_process_th.0 Request processed in 173us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.808276:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788509345.808320:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10368:1875387796744064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509345.808340:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509345.808346:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509345.808353:0:10368:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788509345.808357:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788509345.808502:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788509345.808535:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788509345.808548:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.808562:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509345.808574:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788509345.808577:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd82e88800 from 48 10000000:01000000:3.0:1788509345.808580:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509345.808685:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.808695:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.808784:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509345.808799:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.809115:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.809249:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.809505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796744192 00000100:00100000:3.0:1788509345.809512:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796744192 00000100:00100000:3.0:1788509345.809557:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788509345.809565:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796744192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509345.809579:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509345.809597:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd8f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd8ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.809691:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd8ec expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.809705:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd8ec expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.809772:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031600, rc 0) 00000100:00100000:3.0:1788509345.809970:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796744192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 405us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.809978:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788509345.812700:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509345.812741:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.812758:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509345.812878:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.812971:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.813005:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796744320 00000100:00100000:0.0:1788509345.813011:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.813014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796744320 00000100:00100000:3.0:1788509345.813076:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788509345.813087:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796744320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.813262:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796744320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.813279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788509345.814336:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.814395:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.814466:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.814525:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.814588:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796744448 00000100:00100000:3.0:1788509345.814596:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796744448 00000100:00100000:3.0:1788509345.814648:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788509345.814659:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796744448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.814780:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796744448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.814787:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788509345.814872:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.815350:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10370:1875387796744576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.815395:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.815430:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc877679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.815482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796744576 00000100:00100000:3.0:1788509345.815487:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796744576 00000100:00100000:3.0:1788509345.815522:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788509345.815530:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:10370:x1875387796744576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.815626:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:10370:x1875387796744576:12345-0@lo:502:llog_process_th.0 Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.815633:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788509345.815710:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10370:1875387796744576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.815750:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10370:1875387796744704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.815782:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.815812:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc877679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509345.815852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796744704 00000100:00100000:3.0:1788509345.815856:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796744704 00000100:00100000:3.0:1788509345.815888:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788509345.815924:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:10370:x1875387796744704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.815989:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:10370:x1875387796744704:12345-0@lo:502:llog_process_th.0 Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509345.815997:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788509345.816071:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10370:1875387796744704:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788509345.816087:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788509345.816283:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788509345.816308:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509345.816319:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.816337:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509345.816348:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788509345.816351:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788509345.816354:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788509345.816384:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.816392:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.816400:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509345.816413:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.816442:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.816481:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9820af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.816986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796744832 00000100:00100000:0.0:1788509345.816993:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796744832 00000100:00100000:0.0:1788509345.817036:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788509345.817047:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796744832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509345.817062:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509345.817080:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590b200/0xe5156b86310dd901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd8fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.817106:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590b200/0xe5156b86310dd901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd8fa expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.817118:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590b200/0xe5156b86310dd901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd8fa expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.817128:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b200, rc 0) 00000100:00100000:0.0:1788509345.817187:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796744832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.817193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788509345.817235:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509345.817251:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.817260:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509345.817336:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.817372:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.817396:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.817409:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796744960 00000100:00100000:0.0:1788509345.817412:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796744960 00000100:00100000:0.0:1788509345.817434:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788509345.817439:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796744960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.817568:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796744960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.817574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788509345.817604:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796744960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.817632:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796745088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.817674:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.817687:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.817699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796745088 00000100:00100000:0.0:1788509345.817703:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796745088 00000100:00100000:0.0:1788509345.817724:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788509345.817730:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796745088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.817812:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796745088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.817819:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788509345.817863:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796745088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509345.819227:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10371:1875387796745216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.819301:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.819348:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.819457:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796745216 00000100:00100000:0.0:1788509345.819482:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796745216 00000100:00100000:0.0:1788509345.819539:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788509345.819550:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10371:x1875387796745216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.819688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10371:x1875387796745216:12345-0@lo:502:llog_process_th.0 Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.819696:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788509345.819828:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10371:1875387796745216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788509345.819861:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509345.819874:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509345.819876:0:10371:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788509345.819884:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788509345.819940:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10371:1875387796745344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509345.819983:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509345.820007:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd398780 going to sleep for 11 seconds 00000100:00100000:0.0:1788509345.820484:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796745344 00000100:00100000:0.0:1788509345.820491:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796745344 00000100:00100000:0.0:1788509345.820534:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788509345.820543:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10371:x1875387796745344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509345.820638:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10371:x1875387796745344:12345-0@lo:502:llog_process_th.0 Request processed in 95us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509345.820645:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788509345.820733:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10371:1875387796745344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788509345.820757:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509345.820763:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509345.820765:0:10371:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788509345.820769:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788509345.820990:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788509345.821014:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788509345.821028:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.821042:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509345.821053:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788509345.821056:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bcd9e5d99c0 from 1 10000000:01000000:0.0:1788509345.821060:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788509345.821094:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.821102:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.821119:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509345.821149:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796745472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.821187:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.821224:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.821537:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796745472 00000100:00100000:1.0:1788509345.821543:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796745472 00000100:00100000:1.0:1788509345.821583:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788509345.821591:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796745472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509345.821601:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509345.821631:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8200/0xe5156b86310dd90f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd908 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.821657:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8200/0xe5156b86310dd90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd908 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.821668:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8200/0xe5156b86310dd90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd908 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509345.821679:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8200, rc 0) 00000100:00100000:1.0:1788509345.821737:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796745472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509345.821743:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788509345.823387:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796745472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509345.823419:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd90f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509345.823433:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd90f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509345.823529:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796745600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509345.823593:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509345.823631:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509345.824557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796745600 00000100:00100000:1.0:1788509345.824568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796745600 00000100:00100000:1.0:1788509345.824702:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788509345.824771:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796745600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509345.825088:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796745600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (1494us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788509345.825097:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788509345.827747:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796745600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788509345.827815:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788509345.827829:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd90f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509345.827841:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd90f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.082818:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509346.082921:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509346.082961:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774670976 00000100:00100000:1.0:1788509346.082965:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509346.082975:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774670976 00000100:00100000:1.0:1788509346.082998:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509346.083066:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788509346.083079:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774670976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509346.083189:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774670976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 112us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509346.083197:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00080000:0.0:1788509346.083979:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509346.093752:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509346.093807:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774671104 00000100:00100000:1.0:1788509346.093819:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774671104 00000100:00100000:1.0:1788509346.093934:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788509346.093950:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774671104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509346.094052:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774671104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 108us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509346.094061:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00080000:1.0:1788509346.094106:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509346.096000:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774670592 00000100:00100000:0.0:1788509346.096047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774670592 00000100:00100000:0.0:1788509346.096118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:0.0:1788509346.096129:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2410:x1875387774670592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509346.098048:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2410:x1875387774670592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1913us (15075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509346.098062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:3.0:1788509346.100014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774670720 00000100:00100000:3.0:1788509346.100033:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774670720 00000100:00100000:3.0:1788509346.100254:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774670848 00000100:00100000:3.0:1788509346.100259:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774670848 00000100:00100000:3.0:1788509346.100300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788509346.100314:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774670720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509346.100413:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774670720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 101us (17606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509346.100422:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788509346.100443:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:3.0:1788509346.100450:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774670848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509346.100506:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774670848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 56us (17508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509346.100515:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00080000:0.0:1788509346.103423:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509346.103434:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788509346.266421:0:10396:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffeb80c850 20000000:00000080:3.0:1788509346.266447:0:10396:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bcc87741000 uarg=0000000000000000 20000000:01000000:3.0:1788509346.266518:0:10396:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788509346.266526:0:10396:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788509346.266532:0:10396:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788509346.270210:0:10397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788509346.270395:0:10396:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788509346.281343:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788509346.281404:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788509346.281421:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788509346.281439:0:10396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788509346.281477:0:10396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281501:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd80030600/0xe5156b86310dd5b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281510:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281517:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd60d expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281524:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd733 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281535:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281542:0:10396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281593:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281630:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 9 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.281649:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796745728:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509346.281803:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd733 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.281817:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd733 expref: 23 pid: 6514 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.281826:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796745856:0@lo:104: 00000100:00100000:1.0:1788509346.281883:0:10396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509346.281994:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd60d expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.282003:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd60d expref: 23 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.282011:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796745984:0@lo:104: 00000100:00100000:1.0:1788509346.282041:0:10396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509346.282072:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.282081:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 23 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.282089:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796746112:0@lo:104: 00010000:00010000:1.0:1788509346.282115:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd80030600/0xe5156b86310dd5b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.282131:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd80030600/0xe5156b86310dd5b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 23 pid: 6513 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.282141:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796746240:0@lo:104: 00000100:00100000:3.0:1788509346.282164:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788509346.282173:0:10396:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788509346.282193:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509346.282220:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509346.282221:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796745856 00000100:00100000:1.0:1788509346.282230:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796745856 00000100:00100000:3.0:1788509346.282234:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796745984 00000100:00100000:3.0:1788509346.282241:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796745984 00000100:00100000:1.0:1788509346.282283:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796746240 00000100:00100000:3.0:1788509346.282287:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796746112 00000100:00100000:1.0:1788509346.282288:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796746240 00000100:00100000:3.0:1788509346.282294:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796746112 00000100:00100000:1.0:1788509346.282310:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788509346.282321:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:10396:x1875387796745856:12345-0@lo:104: 00010000:00010000:1.0:1788509346.282336:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509346.282382:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788509346.282392:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7886c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:10396:x1875387796745984:12345-0@lo:104: 00010000:00010000:3.0:1788509346.282403:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.282409:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509346.282417:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:10396:x1875387796745856:12345-0@lo:104: Request processed in 98us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509346.282424:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1788509346.282452:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788509346.282458:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7886c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:10396:x1875387796745984:12345-0@lo:104: Request processed in 69us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509346.282476:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788509346.282636:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509346.282645:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.282656:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509346.282660:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.282671:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509346.282680:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509346.282686:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788509346.282744:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.282751:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509346.282775:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.282796:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd733 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd73a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.282817:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:10396:x1875387796746240:12345-0@lo:104: 00010000:00010000:0.0:1788509346.282819:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509346.282825:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.282829:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.282834:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590aa00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509346.282841:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.282850:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509346.282857:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509346.282862:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509346.282872:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509346.282879:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:10396:x1875387796746240:12345-0@lo:104: Request processed in 396us (658us total) trans 0 rc 0/0 00010000:00010000:0.0:1788509346.282880:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.282890:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509346.284013:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284026:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd60d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284042:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509346.284060:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284066:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030a00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509346.284070:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284079:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509346.284086:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509346.284091:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788509346.284124:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284130:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509346.284151:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284159:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd80030a00/0xe5156b86310dd5ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284170:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509346.284172:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509346.284175:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509346.284197:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796746368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509346.284260:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509346.284312:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509346.284319:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796746496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509346.284345:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788509346.284355:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509346.284407:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796746624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509346.284414:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788509346.284427:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:10396:x1875387796746112:12345-0@lo:104: 00000100:00100000:0.0:1788509346.284435:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788509346.284440:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509346.284485:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796746368 00000100:00100000:0.0:1788509346.284492:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796746368 00010000:00010000:3.0:1788509346.284518:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788509346.284524:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd733 expref: 24 pid: 6514 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509346.284527:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:10396:x1875387796746112:12345-0@lo:104: Request processed in 103us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509346.284542:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788509346.284558:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796746496 00000100:00100000:0.0:1788509346.284562:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796746496 00010000:00010000:3.0:1788509346.284566:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509346.284573:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284577:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd60d expref: 25 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.284590:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226200 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509346.284595:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509346.284598:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796746624 00000100:00100000:0.0:1788509346.284602:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796746624 00010000:00010000:3.0:1788509346.284606:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284615:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd80030600/0xe5156b86310dd5b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 26 pid: 6513 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509346.284627:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788509346.284632:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+26:3644:x1875387796746368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509346.284644:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509346.284649:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd733 expref: 26 pid: 6514 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284659:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd733 expref: 26 pid: 6514 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509346.284680:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1788509346.284689:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509346.284697:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788509346.284710:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+26:3644:x1875387796746368:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (450us total) trans 0 rc 0/0 00010000:00010000:3.0:1788509346.284718:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.284731:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509346.284745:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.284752:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226200/0xe5156b86310dd5b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd5c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.284779:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509346.284781:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509346.284783:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509346.285122:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788509346.285133:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+26:3644:x1875387796746496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509346.285144:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509346.285150:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd60d expref: 26 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.285161:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd60d expref: 26 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.285173:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509346.285203:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+26:3644:x1875387796746496:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509346.285209:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788509346.285226:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788509346.285232:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+25:3646:x1875387796746624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509346.285240:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509346.285245:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd80030600/0xe5156b86310dd5b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 25 pid: 6513 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.285254:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd80030600/0xe5156b86310dd5b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 25 pid: 6513 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.285263:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509346.285282:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+25:3646:x1875387796746624:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509346.285295:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788509346.285339:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796746496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509346.285350:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796746368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509346.285372:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509346.286092:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788509346.286128:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796746752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509346.286183:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509346.286254:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796746624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509346.286298:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796746752 00000100:00100000:3.0:1788509346.286305:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796746752 00010000:00010000:3.0:1788509346.286335:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 24 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509346.286368:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788509346.286375:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796746752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509346.286388:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509346.286392:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 24 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.286402:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 24 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.286421:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509346.286458:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796746752:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509346.286464:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788509346.287389:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509346.287416:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774671232 00000100:00100000:3.0:1788509346.287422:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774671232 00010000:00010000:3.0:1788509346.287453:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 10 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509346.287555:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1788509346.287564:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2407:x1875387774671232:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509346.287578:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509346.287583:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 10 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287594:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 10 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287624:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287634:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287653:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287661:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287669:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287677:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287684:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509346.287690:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287708:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287720:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.287733:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509346.287791:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2407:x1875387774671232:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 228us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509346.287799:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788509346.288097:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796746752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509346.288874:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788509346.288998:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590ae00/0xe5156b86310dd852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f4c expref: 9 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.289018:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796745728:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509346.289034:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226400/0xe5156b86310dd73a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd733 expref: 23 pid: 6514 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.289044:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796745856:0@lo:104: 00010000:00010000:1.0:1788509346.289058:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92925c00/0xe5156b86310dd614 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd60d expref: 22 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.289079:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796745984:0@lo:104: 00010000:00010000:1.0:1788509346.289092:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd5c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd5b9 expref: 21 pid: 6515 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.289103:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796746112:0@lo:104: 00010000:00010000:1.0:1788509346.289122:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd80030600/0xe5156b86310dd5b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd5ab expref: 20 pid: 6513 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509346.289564:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1875387796746240:0@lo:104: 00010000:00010000:1.0:1788509346.289606:0:10396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.289619:0:10396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.289626:0:10396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509346.289645:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310dd916 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509346.646313:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509347.670888:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509347.672938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509347.673056:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774671360 00000100:00100000:3.0:1788509347.673067:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774671360 00000100:00100000:3.0:1788509347.673261:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:3.0:1788509347.673274:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:6182:x1875387774671360:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509347.673292:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509347.673311:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509347.673338:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509347.673350:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509347.673360:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030800, rc 0) 00000100:00100000:3.0:1788509347.673417:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6182:x1875387774671360:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 146us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509347.673434:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:0.0:1788509347.680607:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509347.680886:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774671488 00000100:00100000:3.0:1788509347.680920:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774671488 00000100:00100000:3.0:1788509347.680974:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:3.0:1788509347.680984:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6182:x1875387774671488:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509347.681300:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6182:x1875387774671488:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 315us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509347.681308:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:1.0:1788509347.691527:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509347.691653:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774671616 00000100:00100000:3.0:1788509347.691663:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774671616 00000100:00100000:3.0:1788509347.691733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:3.0:1788509347.691744:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6182:x1875387774671616:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509347.691894:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6182:x1875387774671616:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 151us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509347.691926:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:0.0:1788509347.697323:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509347.697684:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774671744 00000100:00100000:3.0:1788509347.697695:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774671744 00000100:00100000:3.0:1788509347.697753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:3.0:1788509347.697764:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6721:x1875387774671744:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788509347.697923:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6721:x1875387774671744:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 160us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509347.697932:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:1.0:1788509347.703315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509347.703387:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774671872 00000100:00100000:3.0:1788509347.703397:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774671872 00000100:00100000:3.0:1788509347.703464:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 250 00000100:00100000:3.0:1788509347.703474:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6721:x1875387774671872:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788509347.703609:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:6721:x1875387774671872:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 136us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509347.703618:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 250 10000000:01000000:0.0:1788509347.801479:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509347.801486:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdb59c5000 from 4 10000000:01000000:0.0:1788509347.801490:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509347.801536:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.801547:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.801558:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509347.801581:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796746880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.801645:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.801694:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767600 going to sleep for 11 seconds 00000100:00100000:2.0:1788509347.801703:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796746880 00000100:00100000:2.0:1788509347.801710:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796746880 00000100:00100000:2.0:1788509347.801759:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788509347.801769:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796746880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509347.801782:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509347.801795:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd924 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509347.801818:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd924 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509347.801838:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd924 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509347.801848:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227800, rc 0) 00000100:00100000:2.0:1788509347.801894:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796746880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509347.801928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788509347.805568:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796746880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509347.805597:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.805618:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509347.805701:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.805759:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.805809:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767600 going to sleep for 11 seconds 00000100:00100000:3.0:1788509347.807479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796747008 00000100:00100000:3.0:1788509347.807488:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796747008 00000100:00100000:3.0:1788509347.807541:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788509347.807551:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796747008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509347.807698:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796747008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509347.807706:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788509347.807757:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.807800:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.807857:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509347.807921:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8918ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.807966:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796747136 00000100:00100000:0.0:1788509347.807971:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796747136 00000100:00100000:0.0:1788509347.808002:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788509347.808009:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796747136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.808096:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796747136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.808104:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788509347.808189:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.808523:0:10462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10462:1875387796747264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509347.808557:0:10462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509347.808587:0:10462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8918c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.808678:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796747264 00000100:00100000:0.0:1788509347.808682:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796747264 00000100:00100000:0.0:1788509347.808713:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788509347.808720:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10462:x1875387796747264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.808866:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10462:x1875387796747264:12345-0@lo:502:llog_process_th.0 Request processed in 146us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.808874:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788509347.809302:0:10462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10462:1875387796747264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509347.809593:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509347.809603:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509347.809605:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788509347.809611:0:10462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcdb59c5000 00000020:00000080:1.0:1788509347.809614:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788509347.809803:0:10462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10462:1875387796747392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509347.809861:0:10462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509347.809891:0:10462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.810082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796747392 00000100:00100000:0.0:1788509347.810088:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796747392 00000100:00100000:0.0:1788509347.810129:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788509347.810137:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10462:x1875387796747392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.810222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:10462:x1875387796747392:12345-0@lo:502:llog_process_th.0 Request processed in 86us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.810236:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788509347.810960:0:10462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10462:1875387796747392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509347.810983:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509347.810992:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509347.810994:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788509347.810998:0:10462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788509347.811067:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788509347.811089:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509347.811098:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.811286:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509347.811298:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509347.811301:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd913e8000 from 4 10000000:01000000:0.0:1788509347.811304:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509347.811332:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.811341:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.811351:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509347.811442:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.811490:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.811522:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788509347.811581:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796747520 00000100:00100000:1.0:1788509347.811586:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796747520 00000100:00100000:1.0:1788509347.813759:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788509347.813774:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796747520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509347.813789:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509347.813806:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd932 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509347.813831:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd932 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509347.813852:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd932 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509347.813864:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8e00, rc 0) 00000100:00100000:1.0:1788509347.813952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796747520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509347.813958:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788509347.814921:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509347.815106:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.815118:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509347.815207:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.815251:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.815283:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.815302:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796747648 00000100:00100000:0.0:1788509347.815307:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796747648 00000100:00100000:0.0:1788509347.815340:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788509347.815347:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796747648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.815469:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796747648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.815476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788509347.815504:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.815526:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.815559:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.815569:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.815578:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796747776 00000100:00100000:0.0:1788509347.815580:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796747776 00000100:00100000:0.0:1788509347.815593:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788509347.815598:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796747776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.816285:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796747776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 684us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.816292:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788509347.816332:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796747776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.818107:0:10463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10463:1875387796747904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.818188:0:10463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.818221:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796747904 00000100:00100000:0.0:1788509347.818227:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796747904 00000100:00100000:0.0:1788509347.818260:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788509347.818268:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:10463:x1875387796747904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.818368:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:10463:x1875387796747904:12345-0@lo:502:llog_process_th.0 Request processed in 100us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.818375:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788509347.818413:0:10463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.818432:0:10463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10463:1875387796747904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509347.818465:0:10463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509347.818474:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509347.818477:0:10463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788509347.818483:0:10463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcd913e8000 00000020:00000080:0.0:1788509347.818485:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788509347.818546:0:10463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10463:1875387796748032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.818578:0:10463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.818595:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796748032 00000100:00100000:0.0:1788509347.818599:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796748032 00000100:00100000:0.0:1788509347.818616:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788509347.818621:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:10463:x1875387796748032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.818693:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:10463:x1875387796748032:12345-0@lo:502:llog_process_th.0 Request processed in 70us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.818699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788509347.818723:0:10463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.818735:0:10463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10463:1875387796748032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509347.818756:0:10463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509347.818760:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509347.818762:0:10463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788509347.818765:0:10463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788509347.818813:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788509347.820313:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509347.820329:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.820340:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509347.820350:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509347.820353:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdbbf0f800 from 4 10000000:01000000:0.0:1788509347.820356:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509347.820389:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.820397:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.820407:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509347.820427:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.820491:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.820531:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788509347.820948:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796748160 00000100:00100000:1.0:1788509347.820957:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796748160 00000100:00100000:1.0:1788509347.821004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788509347.821014:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796748160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509347.821026:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509347.821039:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd940 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509347.821063:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd940 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509347.821083:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd940 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509347.821091:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9200, rc 0) 00000100:00100000:1.0:1788509347.821151:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796748160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509347.821159:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788509347.821213:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509347.821225:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509347.821235:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509347.821291:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.821317:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509347.821336:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509347.821347:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796748288 00000100:00100000:1.0:1788509347.821350:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796748288 00000100:00100000:1.0:1788509347.821371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788509347.821378:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796748288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.821482:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796748288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509347.821489:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788509347.821519:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.821551:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.821586:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509347.821598:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509347.821609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796748416 00000100:00100000:1.0:1788509347.821612:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796748416 00000100:00100000:0.0:1788509347.821938:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788509347.821948:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796748416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.822024:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796748416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.822036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788509347.822078:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.822232:0:10464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10464:1875387796748544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.822266:0:10464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.822282:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796748544 00000100:00100000:0.0:1788509347.822286:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796748544 00000100:00100000:0.0:1788509347.822302:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788509347.822308:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10464:x1875387796748544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.822367:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10464:x1875387796748544:12345-0@lo:502:llog_process_th.0 Request processed in 59us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.822374:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788509347.822409:0:10464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.822421:0:10464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10464:1875387796748544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509347.822439:0:10464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509347.822448:0:10464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509347.822450:0:10464:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788509347.822468:0:10464:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcdbbf0f800 00000020:00000080:0.0:1788509347.822471:0:10464:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788509347.822526:0:10464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10464:1875387796748672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.822556:0:10464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.822572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796748672 00000100:00100000:0.0:1788509347.822575:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796748672 00000100:00100000:0.0:1788509347.822590:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788509347.822596:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10464:x1875387796748672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.824978:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:10464:x1875387796748672:12345-0@lo:502:llog_process_th.0 Request processed in 2372us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.824996:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788509347.825059:0:10464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8109a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.825082:0:10464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10464:1875387796748672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509347.826431:0:10464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509347.826442:0:10464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509347.826444:0:10464:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788509347.826449:0:10464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788509347.826620:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788509347.826728:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788509347.826739:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509347.826750:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509347.826760:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788509347.826763:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd82e88800 from 4 10000000:01000000:2.0:1788509347.826766:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788509347.826801:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509347.826809:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509347.826819:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509347.827259:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788509347.827318:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509347.828530:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.831666:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796748800 00000100:00100000:0.0:1788509347.831685:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796748800 00000100:00100000:0.0:1788509347.831743:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788509347.831753:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796748800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509347.831768:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509347.831785:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd94e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.831890:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd94e expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.832038:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd94e expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509347.832048:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a800, rc 0) 00000100:00100000:0.0:1788509347.832360:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796748800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 608us (5040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.832377:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788509347.832975:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509347.832998:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509347.833009:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509347.833082:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509347.833513:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509347.833586:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.833632:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796748928 00000100:00100000:0.0:1788509347.833638:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796748928 00000100:00100000:0.0:1788509347.833680:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788509347.833697:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796748928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509347.833949:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796748928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.833958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788509347.834017:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796748928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509347.834052:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796749056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509347.834099:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509347.834198:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788509347.834748:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796749056 00000100:00100000:1.0:1788509347.834754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796749056 00000100:00100000:1.0:1788509347.834798:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788509347.834806:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796749056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.834957:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796749056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509347.834964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788509347.835023:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796749056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509347.839340:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10468:1875387796749184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509347.839421:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509347.839465:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796749184 00000100:00100000:0.0:1788509347.839472:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796749184 00000100:00100000:1.0:1788509347.839476:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788509347.839521:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788509347.839530:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:10468:x1875387796749184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509347.839649:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:10468:x1875387796749184:12345-0@lo:502:llog_process_th.0 Request processed in 119us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509347.839657:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788509347.839945:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10468:1875387796749184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509347.839973:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509347.839982:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509347.839984:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788509347.839991:0:10468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcd82e88800 00000020:00000080:1.0:1788509347.839993:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788509347.840070:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10468:1875387796749312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509347.840104:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509347.840139:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796749312 00000100:00100000:1.0:1788509347.840149:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796749312 00000100:00100000:1.0:1788509347.840175:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788509347.840182:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:10468:x1875387796749312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509347.840244:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:10468:x1875387796749312:12345-0@lo:502:llog_process_th.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509347.840250:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788509347.840295:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788509347.840306:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:10468:1875387796749312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509347.840322:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509347.840326:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509347.840328:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788509347.840331:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788509347.840496:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788509347.840519:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788509347.840529:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509347.840539:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509348.573187:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509348.573210:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796749440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509348.573276:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509348.573340:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796749440 00000100:00100000:2.0:1788509348.573348:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796749440 00000100:00100000:2.0:1788509348.573421:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788509348.573429:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796749440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509348.573474:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788509348.573521:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796749440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509348.573527:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788509348.573584:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796749440:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788509348.694152:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509349.078175:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796749568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509349.078244:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509349.078444:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796749568 00000100:00100000:1.0:1788509349.078466:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796749568 00000100:00080000:0.0:1788509349.078556:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509349.078646:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788509349.078658:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796749568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509349.078685:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509349.078742:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796749568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509349.078748:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788509349.078825:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876ad880 x1875387796749568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509349.078844:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796749568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509349.079487:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796749696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509349.079527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509349.079557:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796750208:0@lo:400:kworker.0 00000100:00100000:0.0:1788509349.079579:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509349.079598:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796750720:0@lo:400:kworker.0 00000100:00100000:0.0:1788509349.079620:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509349.079636:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796751232:0@lo:400:kworker.0 00000100:00100000:0.0:1788509349.079653:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509349.079671:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788509349.079691:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796749824:0@lo:400:kworker.0 00000100:00100000:0.0:1788509349.079718:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509349.079740:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796750336:0@lo:400:kworker.0 00000100:00100000:0.0:1788509349.079759:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509349.079787:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796750848:0@lo:400:kworker.0 00000100:00100000:0.0:1788509349.079808:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509349.079825:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796751360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509349.079856:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509349.080013:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796749696 00000100:00100000:2.0:1788509349.080020:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796749696 00000100:00100000:2.0:1788509349.080050:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796750336 00000100:00100000:2.0:1788509349.080053:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796750336 00000100:00100000:2.0:1788509349.080064:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788509349.080070:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796749696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509349.080095:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788509349.080131:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796749696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.080137:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788509349.080150:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788509349.080155:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796750336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080179:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796750336:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.080184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788509349.080234:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796750720 00000100:00100000:2.0:1788509349.080238:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796750720 00000100:00100000:2.0:1788509349.080264:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796751232 00000100:00100000:2.0:1788509349.080267:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796751232 00000100:00100000:2.0:1788509349.080276:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796750848 00000100:00100000:2.0:1788509349.080284:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796750848 00000100:00100000:2.0:1788509349.080300:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509349.080305:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796750720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080332:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796750720:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.080338:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509349.080347:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788509349.080352:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796751232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080372:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796751232:12345-0@lo:400:kworker.0 Request processed in 20us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.080377:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788509349.080385:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509349.080390:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796750848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080411:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796750848:12345-0@lo:400:kworker.0 Request processed in 22us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.080416:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788509349.080433:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796750208 00000100:00100000:2.0:1788509349.080436:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796750208 00000100:00100000:2.0:1788509349.080473:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788509349.080480:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796750208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080509:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796750208:12345-0@lo:400:kworker.0 Request processed in 30us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.080514:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788509349.080542:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796749952:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509349.080585:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796750464:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080612:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509349.080630:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796750976:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080649:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509349.080667:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788509349.080672:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796750080:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080691:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509349.080706:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796750592:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080725:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509349.080739:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796751104:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080756:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509349.080775:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796749952 00000100:00100000:2.0:1788509349.080779:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796749952 00000100:00100000:2.0:1788509349.080795:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796750464 00000100:00100000:2.0:1788509349.080797:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796750464 00000100:00100000:2.0:1788509349.080807:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796750976 00000100:00100000:2.0:1788509349.080809:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796750976 00000100:00100000:2.0:1788509349.080819:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796750592 00000100:00100000:2.0:1788509349.080822:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796750592 00000100:00100000:2.0:1788509349.080831:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796751104 00000100:00100000:2.0:1788509349.080833:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796751104 00000100:00100000:2.0:1788509349.080845:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788509349.080851:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796749952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080921:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796749952:12345-0@lo:400:kworker.0 Request processed in 48us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.080927:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788509349.080939:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788509349.080945:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796750464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.080981:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796750464:12345-0@lo:400:kworker.0 Request processed in 37us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.080988:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788509349.080999:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788509349.081004:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796750976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081027:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796750976:12345-0@lo:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.081032:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788509349.081043:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788509349.081048:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796750592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081072:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796750592:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.081077:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788509349.081087:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788509349.081093:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796751104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081118:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796751104:12345-0@lo:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.081123:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788509349.081142:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796750080 00000100:00100000:2.0:1788509349.081145:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796750080 00000100:00100000:2.0:1788509349.081164:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788509349.081169:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796750080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081197:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796750080:12345-0@lo:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.081203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788509349.081247:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796750080:0@lo:400:kworker.0 00010000:00080000:2.0:1788509349.081260:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356d80 x1875387796750592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509349.081269:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796750592:0@lo:400:kworker.0 00010000:00080000:2.0:1788509349.081278:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356300 x1875387796751104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509349.081286:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796751104:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081296:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796749952:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081305:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796750464:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081312:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796750976:0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796749824 00000100:00100000:2.0:1788509349.081370:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796749824 00000100:00100000:2.0:1788509349.081394:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788509349.081401:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796749824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509349.081432:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796749824:12345-0@lo:400:kworker.0 Request processed in 32us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509349.081438:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788509349.081489:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509349.081493:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509349.081496:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788509349.081497:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509349.089980:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796751360 00000100:00100000:3.0:1788509349.089996:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796751360 00000100:00100000:3.0:1788509349.090053:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788509349.090063:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796751360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509349.090099:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509349.090181:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796751360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (10323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509349.090189:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788509349.096204:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913e7b80 x1875387796751360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509349.096232:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796751360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509349.096250:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796749696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509349.096263:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796750208:0@lo:400:kworker.0 00010000:00080000:0.0:1788509349.096276:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87357b80 x1875387796750720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509349.096285:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796750720:0@lo:400:kworker.0 00010000:00080000:0.0:1788509349.096294:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87354000 x1875387796751232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509349.096302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796751232:0@lo:400:kworker.0 00000100:00100000:0.0:1788509349.096335:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796749824:0@lo:400:kworker.0 00000100:00100000:0.0:1788509349.096345:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796750336:0@lo:400:kworker.0 00010000:00080000:0.0:1788509349.096355:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87354e00 x1875387796750848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509349.096379:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796750848:0@lo:400:kworker.0 00000100:00100000:3.0:1788509349.590229:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509349.590261:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796751488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509349.590363:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509349.590454:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796751488 00000100:00100000:3.0:1788509349.590463:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796751488 00000100:00100000:3.0:1788509349.590696:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788509349.590709:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796751488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509349.590764:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509349.590950:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796751488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 243us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509349.590959:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788509349.590998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796751616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509349.591027:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788509349.591086:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787aa00 x1875387796751488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509349.591109:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796751488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509349.591190:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796751616 00000100:00100000:0.0:1788509349.591196:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796751616 00000100:00100000:0.0:1788509349.591229:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788509349.591238:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796751616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509349.591250:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509349.591288:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796751616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509349.591294:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788509349.591422:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787a300 x1875387796751616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509349.591436:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796751616:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788509349.721604:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509350.742331:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509351.205564:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509351.205870:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774672000 00000100:00100000:3.0:1788509351.205879:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774672000 00000100:00100000:3.0:1788509351.206013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:3.0:1788509351.206025:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2408:x1875387774672000:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509351.206533:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2408:x1875387774672000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 509us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509351.206542:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:0.0:1788509351.209199:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509351.209248:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509351.209270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509351.209292:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509351.209315:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774672384 00000100:00100000:0.0:1788509351.209323:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774672384 00000100:00100000:3.0:1788509351.209479:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774672128 00000100:00100000:3.0:1788509351.209484:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774672128 00000100:00100000:0.0:1788509351.209548:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774672512 00000100:00100000:0.0:1788509351.209551:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774672512 00000100:00100000:3.0:1788509351.210200:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774672256 00000100:00100000:3.0:1788509351.210205:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774672256 00000100:00100000:0.0:1788509351.210373:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788509351.210383:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774672384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509351.210460:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774672384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509351.210468:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788509351.210484:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1788509351.210491:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774672512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509351.210522:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774672512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509351.210529:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788509351.212495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788509351.212520:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774672128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509351.212590:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774672128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509351.212599:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788509351.212622:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1788509351.212630:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774672256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509351.212656:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774672256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509351.212663:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00080000:0.0:1788509351.212936:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509351.212942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509351.212944:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509351.212947:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788509351.766397:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788509352.346506:0:10696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788509352.791285:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509353.686306:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796751744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509353.686381:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509353.686696:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796751744 00000100:00100000:2.0:1788509353.686704:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796751744 00000100:00100000:2.0:1788509353.686766:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788509353.686776:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796751744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509353.686810:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788509353.686868:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796751744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509353.686875:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788509353.687024:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796751744:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509353.816973:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509354.198185:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796752000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509354.198260:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509354.198339:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509354.198346:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796752128:0@lo:400:kworker.0 00000100:00100000:3.0:1788509354.198376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509354.198407:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796751872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509354.198447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509354.198480:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796752000 00000100:00100000:3.0:1788509354.198487:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796752000 00000100:00100000:3.0:1788509354.198538:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788509354.198547:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796752000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509354.198576:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509354.198617:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796752000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509354.198624:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788509354.198644:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788509354.198670:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787ad80 x1875387796752000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509354.198688:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796752000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509354.198724:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796752128 00000100:00100000:3.0:1788509354.198728:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796752128 00000100:00100000:3.0:1788509354.198754:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788509354.198761:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796752128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509354.198794:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796752128:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509354.198800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788509354.198944:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796751872 00000100:00100000:0.0:1788509354.198948:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796751872 00000100:00100000:0.0:1788509354.198978:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788509354.198986:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796751872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509354.199010:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788509354.199051:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796751872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509354.199057:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788509354.199185:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796751872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509354.199304:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796752256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509354.199336:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509354.199379:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796752256 00000100:00100000:1.0:1788509354.199383:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796752256 00000100:00100000:1.0:1788509354.199429:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788509354.199445:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796752256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509354.199458:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509354.199495:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796752256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509354.199501:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788509354.199528:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788509354.199545:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876ae300 x1875387796752256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509354.199558:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796752256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509354.200738:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796752128:0@lo:400:kworker.0 00000100:00100000:0.0:1788509354.205126:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796752384:0@lo:400:kworker.0 00000100:00100000:0.0:1788509354.205282:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509354.205487:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796752384 00000100:00100000:3.0:1788509354.205510:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796752384 00000100:00100000:3.0:1788509354.205575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788509354.205584:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796752384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.205930:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796752768:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.205963:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509354.206004:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796752768 00000100:00100000:1.0:1788509354.206008:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796752768 00000100:00100000:1.0:1788509354.206042:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788509354.206050:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796752768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.206085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796752768:12345-0@lo:400:kworker.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509354.206092:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788509354.206125:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509354.206166:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796752768:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.206212:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796752640:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.206240:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509354.206275:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509354.206281:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796752512:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.206304:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509354.206339:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796752640 00000100:00100000:1.0:1788509354.206343:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796752640 00000100:00100000:1.0:1788509354.206370:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788509354.206376:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796752640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.206424:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796752640:12345-0@lo:400:kworker.0 Request processed in 37us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509354.206431:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788509354.206450:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796752512 00000100:00100000:1.0:1788509354.206454:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796752512 00000100:00100000:1.0:1788509354.206473:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788509354.206479:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796752512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.206508:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796752512:12345-0@lo:400:kworker.0 Request processed in 29us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509354.206514:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788509354.206541:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796752512:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.206551:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796752640:0@lo:400:kworker.0 00000100:00100000:3.0:1788509354.206978:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796752384:12345-0@lo:400:kworker.0 Request processed in 1393us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509354.206986:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788509354.207177:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796753024:0@lo:400:kworker.0 00000100:00100000:3.0:1788509354.207219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509354.207246:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509354.207252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796753152:0@lo:400:kworker.0 00000100:00100000:3.0:1788509354.207285:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509354.207322:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796753024 00000100:00100000:3.0:1788509354.207327:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796753024 00000100:00100000:3.0:1788509354.207358:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796753152 00000100:00100000:3.0:1788509354.207362:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796753152 00000100:00100000:3.0:1788509354.207382:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788509354.207388:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796753024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509354.207435:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796753024:12345-0@lo:400:kworker.0 Request processed in 47us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509354.207442:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788509354.207453:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788509354.207459:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796753152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509354.207485:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796753152:12345-0@lo:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509354.207490:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788509354.207504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788509354.207523:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356680 x1875387796753152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509354.207543:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796753152:0@lo:400:kworker.0 00010000:00080000:3.0:1788509354.207556:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87354380 x1875387796753024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509354.207563:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796753024:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.208111:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796753280:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.208155:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509354.208226:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788509354.208232:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796752896:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.208270:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509354.208543:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796752384:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.208809:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796753408:0@lo:400:kworker.0 00000100:00100000:1.0:1788509354.208836:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509354.208895:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796753280 00000100:00100000:2.0:1788509354.208927:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796753280 00000100:00100000:2.0:1788509354.208981:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796752896 00000100:00100000:2.0:1788509354.208985:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796752896 00000100:00100000:2.0:1788509354.209009:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788509354.209016:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796753280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509354.209057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796753280:12345-0@lo:400:kworker.0 Request processed in 42us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509354.209076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788509354.209091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788509354.209096:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796752896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509354.209123:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796752896:12345-0@lo:400:kworker.0 Request processed in 28us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509354.209128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788509354.210252:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796753280:0@lo:400:kworker.0 00010000:00080000:1.0:1788509354.210280:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87355500 x1875387796752896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509354.210302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796752896:0@lo:400:kworker.0 00000100:00100000:2.0:1788509354.211583:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796753408 00000100:00100000:2.0:1788509354.211592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796753408 00000100:00100000:2.0:1788509354.211648:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788509354.211860:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796753408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509354.211966:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796753408:12345-0@lo:400:kworker.0 Request processed in 111us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509354.211973:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1788509354.212080:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356300 x1875387796753408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509354.212094:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796753408:0@lo:400:kworker.0 00000100:00080000:0.0:1788509354.212722:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509354.212728:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509354.712828:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796753536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509354.712951:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509354.713021:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509354.713029:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796753664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509354.713056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509354.713095:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796753536 00000100:00100000:3.0:1788509354.713105:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796753536 00000100:00100000:3.0:1788509354.713155:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796753664 00000100:00100000:3.0:1788509354.713158:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796753664 00000100:00100000:3.0:1788509354.713174:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788509354.713183:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796753536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509354.713223:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509354.713272:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796753536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509354.713421:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788509354.713446:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509354.713453:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796753664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509354.713464:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509354.713501:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796753664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509354.713527:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788509354.713576:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7870700 x1875387796753664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509354.713597:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796753664:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788509354.713609:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7871f80 x1875387796753536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509354.713620:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796753536:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788509354.838206:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509355.865775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509356.308497:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509356.308552:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509356.308577:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509356.308592:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509356.308625:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509356.308693:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774673152 00000100:00100000:3.0:1788509356.308704:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774673152 00000100:00100000:3.0:1788509356.308768:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774673024 00000100:00100000:3.0:1788509356.308771:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774673024 00000100:00100000:3.0:1788509356.308793:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1788509356.308803:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774673152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509356.308872:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774673152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509356.308878:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1788509356.308893:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788509356.308914:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774673024:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509356.308935:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774673024:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509356.308940:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1788509356.309135:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774672640 00000100:00100000:2.0:1788509356.309140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774672640 00000100:00100000:2.0:1788509356.309169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:2.0:1788509356.309176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2407:x1875387774672640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509356.309300:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2407:x1875387774672640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 124us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509356.309307:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:2.0:1788509356.309338:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774672896 00000100:00100000:2.0:1788509356.309342:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774672896 00000100:00100000:2.0:1788509356.309368:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774672768 00000100:00100000:2.0:1788509356.309370:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774672768 00000100:00100000:2.0:1788509356.309392:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788509356.309416:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774672896:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509356.309444:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774672896:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509356.309450:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788509356.309462:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:2.0:1788509356.309468:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774672768:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509356.309490:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774672768:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509356.309495:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00080000:1.0:1788509356.309853:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509356.309858:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509356.309860:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509356.309862:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788509356.888617:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788509357.859262:0:10940:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing yml_node 00010000:00010000:3.0:1788509357.911048:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509358.808352:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796753792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509358.808437:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509358.808671:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796753792 00000100:00100000:2.0:1788509358.808679:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796753792 00000100:00100000:2.0:1788509358.808748:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788509358.808758:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796753792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509358.808790:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788509358.808835:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796753792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509358.808843:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788509358.809053:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796753792:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788509358.939303:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509359.318290:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796753920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509359.318365:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.318702:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796754048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509359.318743:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.318764:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796754560:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.318786:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.318802:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796755072:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.318823:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.318850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796755584:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.318868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.318886:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788509359.318892:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796754176:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.318938:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.318959:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796754688:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.318980:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.318996:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796755200:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319015:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.319057:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796754048 00000100:00100000:3.0:1788509359.319066:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796754048 00000100:00100000:3.0:1788509359.319106:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796754688 00000100:00100000:3.0:1788509359.319110:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796754688 00000100:00100000:3.0:1788509359.319126:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788509359.319133:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796754048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509359.319175:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509359.319221:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796754048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.319227:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788509359.319245:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788509359.319251:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796754688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319280:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796754688:12345-0@lo:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.319285:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788509359.319302:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796754560 00000100:00100000:3.0:1788509359.319305:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796754560 00000100:00100000:3.0:1788509359.319329:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788509359.319335:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796754560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319363:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796754560:12345-0@lo:400:kworker.0 Request processed in 28us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.319369:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788509359.319400:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796755072 00000100:00100000:3.0:1788509359.319403:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796755072 00000100:00100000:3.0:1788509359.319432:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796755584 00000100:00100000:3.0:1788509359.319435:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796755584 00000100:00100000:3.0:1788509359.319446:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796755200 00000100:00100000:3.0:1788509359.319448:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796755200 00000100:00100000:3.0:1788509359.319463:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788509359.319468:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796755072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319496:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796755072:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.319502:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788509359.319520:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788509359.319525:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796755584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319554:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796755584:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.319559:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788509359.319568:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788509359.319573:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796755200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319596:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796755200:12345-0@lo:400:kworker.0 Request processed in 23us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.319601:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788509359.319619:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796754176 00000100:00100000:3.0:1788509359.319623:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796754176 00000100:00100000:3.0:1788509359.319642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788509359.319648:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796754176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796754176:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.319681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:3.0:1788509359.319717:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509359.319721:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509359.319746:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796754176:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319757:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796754688:0@lo:400:kworker.0 00010000:00080000:3.0:1788509359.319769:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787ea00 x1875387796755200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509359.319777:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796755200:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.319788:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796754048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509359.319805:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796754560:0@lo:400:kworker.0 00010000:00080000:3.0:1788509359.319813:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787df80 x1875387796755072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509359.319819:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796755072:0@lo:400:kworker.0 00010000:00080000:3.0:1788509359.319827:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787d880 x1875387796755584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509359.319833:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796755584:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320116:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796754432:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320150:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509359.320176:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796754944:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320198:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509359.320215:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796755456:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320245:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509359.320266:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788509359.320272:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796754304:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320292:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509359.320307:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796754816:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320327:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509359.320342:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796755328:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320359:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509359.320389:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796754944 00000100:00100000:2.0:1788509359.320393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796754944 00000100:00100000:2.0:1788509359.320421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796755456 00000100:00100000:2.0:1788509359.320424:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796755456 00000100:00100000:2.0:1788509359.320436:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796754304 00000100:00100000:2.0:1788509359.320438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796754304 00000100:00100000:2.0:1788509359.320449:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796754816 00000100:00100000:2.0:1788509359.320451:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796754816 00000100:00100000:2.0:1788509359.320461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796755328 00000100:00100000:2.0:1788509359.320464:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796755328 00000100:00100000:2.0:1788509359.320479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788509359.320485:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796754944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320522:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796754944:12345-0@lo:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509359.320528:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788509359.320542:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788509359.320548:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796755456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796755456:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509359.320589:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788509359.320602:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788509359.320608:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796754304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320636:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796754304:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509359.320641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788509359.320652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788509359.320657:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796754816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320684:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796754816:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509359.320689:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788509359.320700:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788509359.320705:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796755328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320744:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796755328:12345-0@lo:400:kworker.0 Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509359.320749:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788509359.320770:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509359.320774:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509359.320794:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796754304:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320803:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796754816:0@lo:400:kworker.0 00000100:00100000:2.0:1788509359.320812:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796755328:0@lo:400:kworker.0 00010000:00080000:2.0:1788509359.320821:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787e680 x1875387796754944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509359.320831:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796754944:0@lo:400:kworker.0 00010000:00080000:2.0:1788509359.320849:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787f800 x1875387796755456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509359.320856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796755456:0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.320983:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796754432 00000100:00100000:3.0:1788509359.320988:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796754432 00000100:00100000:3.0:1788509359.321021:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788509359.321028:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796754432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509359.321138:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796754432:12345-0@lo:400:kworker.0 Request processed in 111us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.321145:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788509359.321216:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796753920 00000100:00100000:0.0:1788509359.321221:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796753920 00000100:00100000:0.0:1788509359.321263:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788509359.321269:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796753920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509359.321291:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509359.321325:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796753920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509359.321330:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788509359.321398:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509359.321606:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509359.321618:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796755712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509359.321651:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509359.321738:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796755712 00000100:00100000:0.0:1788509359.321742:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796755712 00000100:00100000:0.0:1788509359.321771:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788509359.321778:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796755712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788509359.321788:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509359.321820:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796755712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509359.321826:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788509359.321852:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7878e00 x1875387796755712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509359.321865:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796755712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509359.322180:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796754432:0@lo:400:kworker.0 00010000:00080000:2.0:1788509359.322194:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7879c00 x1875387796753920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509359.322206:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796753920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509359.830228:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796755840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509359.830307:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509359.830621:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796755840 00000100:00100000:3.0:1788509359.830630:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796755840 00000100:00100000:3.0:1788509359.830684:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788509359.830694:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796755840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509359.830723:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509359.830768:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796755840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509359.830775:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788509359.830833:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796755968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509359.830872:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788509359.831041:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787d880 x1875387796755840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509359.831060:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796755840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509359.831289:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796755968 00000100:00100000:0.0:1788509359.831294:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796755968 00000100:00100000:0.0:1788509359.831335:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788509359.831342:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796755968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509359.831353:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509359.831418:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796755968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509359.831444:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788509359.831455:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7878e00 x1875387796755968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509359.831469:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796755968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788509359.958576:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509360.983822:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509361.452074:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509361.452133:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509361.452163:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509361.452189:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509361.452213:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509361.452242:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774673408 00000100:00100000:3.0:1788509361.452252:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774673408 00000100:00100000:3.0:1788509361.452311:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774673536 00000100:00100000:3.0:1788509361.452315:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774673536 00000100:00100000:3.0:1788509361.452338:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1788509361.452348:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774673408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509361.452426:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774673408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509361.452432:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1788509361.452449:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1788509361.452455:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774673536:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509361.452479:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774673536:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509361.452485:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1788509361.452502:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774673664 00000100:00100000:3.0:1788509361.452506:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774673664 00000100:00100000:3.0:1788509361.452529:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774673792 00000100:00100000:3.0:1788509361.452532:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774673792 00000100:00100000:3.0:1788509361.452551:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1788509361.452557:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2406:x1875387774673664:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788509361.452592:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd86e 00000100:00080000:3.0:1788509361.452603:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8bcc86042800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788509361.452751:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788509361.452762:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2406:x1875387774673792:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:0.0:1788509361.452779:0:8756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd867 00000100:00080000:0.0:1788509361.452786:0:8756:0:(import.c:65:import_set_state_nolock()) ffff8bcdb786c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788509361.452826:0:8756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788509361.452976:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+2:2406:x1875387774673792:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 218us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509361.452983:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00080000:0.0:1788509361.453001:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509361.453005:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509361.453007:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509361.453009:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788509361.453065:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509361.453247:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774673280 00000100:00100000:1.0:1788509361.453252:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774673280 00000100:00100000:1.0:1788509361.453296:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00100000:1.0:1788509361.453304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2408:x1875387774673280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509361.453333:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2408:x1875387774673280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509361.453349:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 276 00000001:00000004:3.0:1788509361.454234:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788509361.454455:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+2:2406:x1875387774673664:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 1894us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509361.454463:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00010000:00010000:0.0:1788509361.462076:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509362.006273:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788509362.772770:0:11123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00010000:00010000:1.0:1788509363.043449:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509363.927542:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796756096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509363.927638:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509363.927935:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796756096 00000100:00100000:2.0:1788509363.927947:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796756096 00000100:00100000:2.0:1788509363.928013:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788509363.928024:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796756096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509363.928069:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788509363.928129:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796756096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509363.928135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788509363.928733:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796756096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788509364.063639:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509364.440889:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509364.440935:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796756352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509364.441036:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.441290:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796756224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509364.441333:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.441395:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796756352 00000100:00100000:3.0:1788509364.441405:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796756352 00000100:00100000:3.0:1788509364.441483:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788509364.441496:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796756352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509364.441536:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509364.441584:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796756352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.441591:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788509364.441674:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796756224 00000100:00100000:2.0:1788509364.441679:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796756224 00000100:00100000:2.0:1788509364.441716:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788509364.441724:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796756224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509364.441756:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788509364.441798:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796756224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509364.441804:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788509364.442093:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796756864:0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442132:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509364.442152:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796757376:0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442173:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509364.442194:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788509364.442200:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796756480:0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442231:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509364.442257:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796756992:0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442308:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509364.442338:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796757504:0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509364.442403:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796756864 00000100:00100000:0.0:1788509364.442407:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796756864 00000100:00100000:0.0:1788509364.442439:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796757376 00000100:00100000:0.0:1788509364.442442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796757376 00000100:00100000:0.0:1788509364.442456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796756992 00000100:00100000:0.0:1788509364.442458:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796756992 00000100:00100000:0.0:1788509364.442470:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796757504 00000100:00100000:0.0:1788509364.442474:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796757504 00000100:00100000:0.0:1788509364.442488:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788509364.442495:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796756864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442537:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796756864:12345-0@lo:400:kworker.0 Request processed in 41us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509364.442544:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788509364.442558:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788509364.442564:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796757376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442589:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796757376:12345-0@lo:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509364.442595:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788509364.442605:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788509364.442611:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796756992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442636:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796756992:12345-0@lo:400:kworker.0 Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509364.442641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788509364.442650:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788509364.442656:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796757504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442694:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796757504:12345-0@lo:400:kworker.0 Request processed in 38us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509364.442701:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788509364.442721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796756480 00000100:00100000:0.0:1788509364.442725:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796756480 00000100:00100000:0.0:1788509364.442751:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788509364.442757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796756480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442788:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796756480:12345-0@lo:400:kworker.0 Request processed in 31us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509364.442794:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788509364.442852:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796756480:0@lo:400:kworker.0 00010000:00080000:0.0:1788509364.442868:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7878a80 x1875387796756992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509364.442881:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796756992:0@lo:400:kworker.0 00010000:00080000:0.0:1788509364.442889:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787ad80 x1875387796757504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509364.442924:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796757504:0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442935:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796756864:0@lo:400:kworker.0 00000100:00100000:0.0:1788509364.442944:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796757376:0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.443599:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796756608:0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.443652:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.443689:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796757120:0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.443716:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.443748:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796757632:0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.443772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.443799:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788509364.443805:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796756736:0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.443826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.443862:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796757248:0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.443887:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.443930:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796757760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509364.443954:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.443994:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796757120 00000100:00100000:3.0:1788509364.444000:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796757120 00000100:00100000:3.0:1788509364.444051:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796757632 00000100:00100000:3.0:1788509364.444054:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796757632 00000100:00100000:3.0:1788509364.444071:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796757248 00000100:00100000:3.0:1788509364.444074:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796757248 00000100:00100000:3.0:1788509364.444087:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788509364.444095:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796757120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.444147:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796757120:12345-0@lo:400:kworker.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.444155:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788509364.444171:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509364.444178:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796757632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.444205:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796757632:12345-0@lo:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.444212:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509364.444221:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788509364.444227:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796757248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.444255:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796757248:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.444261:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788509364.444461:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796757760 00000100:00100000:3.0:1788509364.444466:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796757760 00000100:00100000:3.0:1788509364.444504:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788509364.444511:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796757760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509364.444527:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509364.444560:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796757760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.444566:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788509364.444588:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796756608 00000100:00100000:3.0:1788509364.444592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796756608 00000100:00100000:3.0:1788509364.444618:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796756736 00000100:00100000:3.0:1788509364.444621:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796756736 00000100:00100000:3.0:1788509364.444639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788509364.444644:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796756608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.444675:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796756608:12345-0@lo:400:kworker.0 Request processed in 30us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.444680:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788509364.444691:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788509364.444697:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796756736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509364.444723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796756736:12345-0@lo:400:kworker.0 Request processed in 26us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.444729:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788509364.444785:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796756224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509364.444826:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796756736:0@lo:400:kworker.0 00010000:00080000:3.0:1788509364.444838:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7878e00 x1875387796757248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509364.444847:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796757248:0@lo:400:kworker.0 00010000:00080000:3.0:1788509364.444869:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87354380 x1875387796757760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509364.444882:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796757760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509364.444892:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796756608:0@lo:400:kworker.0 00010000:00080000:3.0:1788509364.444935:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787a680 x1875387796757120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509364.444943:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796757120:0@lo:400:kworker.0 00010000:00080000:3.0:1788509364.444952:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787a300 x1875387796757632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509364.444959:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796757632:0@lo:400:kworker.0 00000100:00080000:1.0:1788509364.446238:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509364.446250:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509364.446253:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509364.446256:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788509364.446323:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87dde680 x1875387796756352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509364.446359:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796756352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509364.950350:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796757888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509364.950464:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.950560:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796757888 00000100:00100000:3.0:1788509364.950571:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796757888 00000100:00100000:3.0:1788509364.950632:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788509364.950644:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796757888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509364.950690:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509364.950760:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796757888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.950770:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788509364.954888:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788f100 x1875387796757888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509364.954966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796757888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509364.956440:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788509364.956465:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796758016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509364.956686:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509364.956759:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796758016 00000100:00100000:3.0:1788509364.956769:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796758016 00000100:00100000:3.0:1788509364.957481:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788509364.957494:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796758016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509364.957535:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509364.957605:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796758016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509364.957614:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788509364.957843:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787ed80 x1875387796758016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509364.957871:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796758016:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788509365.079431:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788509365.545515:0:11221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00010000:00010000:2.0:1788509366.102964:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509366.547828:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509366.547884:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509366.547956:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509366.547993:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774674048 00000100:00100000:0.0:1788509366.548013:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774674048 00000100:00100000:0.0:1788509366.548090:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774674176 00000100:00100000:0.0:1788509366.548093:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774674176 00000100:00100000:0.0:1788509366.548122:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788509366.548134:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2409:x1875387774674048:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509366.548236:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2409:x1875387774674048:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 103us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509366.548245:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788509366.548266:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1788509366.548273:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774674176:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509366.548301:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774674176:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509366.548308:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00080000:0.0:1788509366.548324:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509366.548459:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774673920 00000100:00100000:1.0:1788509366.548464:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774673920 00000100:00100000:1.0:1788509366.548501:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:1.0:1788509366.548509:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2409:x1875387774673920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509366.548536:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2409:x1875387774673920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509366.548542:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00080000:0.0:1788509366.548618:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788509367.004937:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:0.0:1788509367.004946:0:8431:0:(genops.c:885:class_export_put()) final put ffff8bcc86044000/d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:3.0:1788509367.006553:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86044000/d1c7a223-cc58-4f2c-be22-e37eba96eeae for lustre-OST0000 00000001:00100000:2.0:1788509367.010769:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:2.0:1788509367.010783:0:9517:0:(genops.c:885:class_export_put()) final put ffff8bcdb786f800/d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:3.0:1788509367.012499:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc86042800 for lustre-OST0000 00000020:00000080:3.0:1788509367.015188:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb786f800/d1c7a223-cc58-4f2c-be22-e37eba96eeae for lustre-OST0001 00000020:00000080:3.0:1788509367.015276:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb786c000 for lustre-OST0001 00010000:00010000:1.0:1788509367.126219:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509368.151406:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788509368.306614:0:11318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00000100:00100000:0.0:1788509369.047933:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509369.047963:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796758144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509369.048054:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509369.048412:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796758144 00000100:00100000:1.0:1788509369.048423:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796758144 00000100:00100000:1.0:1788509369.048504:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788509369.048517:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796758144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509369.048584:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509369.048657:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796758144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509369.048665:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788509369.051773:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796758144:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509369.175136:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509369.558132:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509369.558163:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796758272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509369.558251:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509369.558343:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796758272 00000100:00100000:3.0:1788509369.558353:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796758272 00000100:00100000:3.0:1788509369.558418:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788509369.558430:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796758272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509369.558470:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509369.558520:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796758272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509369.558527:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788509369.558576:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787dc00 x1875387796758272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509369.558599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796758272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509369.559102:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796758400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509369.559144:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509369.559197:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796758400 00000100:00100000:3.0:1788509369.559221:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796758400 00000100:00100000:3.0:1788509369.559258:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788509369.559266:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796758400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509369.559284:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509369.559335:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796758400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509369.559342:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788509369.559370:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787dc00 x1875387796758400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509369.559388:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796758400:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788509369.559421:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509369.559452:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509369.559459:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796758528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509369.559488:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509369.559518:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796758528 00000100:00100000:3.0:1788509369.559522:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796758528 00000100:00100000:3.0:1788509369.559554:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788509369.559561:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796758528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509369.559595:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509369.559634:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796758528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509369.559641:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788509369.559680:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796758528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509369.565875:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796758656:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.566039:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509369.566121:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796758656 00000100:00100000:1.0:1788509369.566131:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796758656 00000100:00100000:1.0:1788509369.566190:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788509369.566199:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796758656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.566259:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796758656:12345-0@lo:400:kworker.0 Request processed in 61us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509369.566267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788509369.566355:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796758656:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.566396:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796758784:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.566427:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509369.566465:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796758784 00000100:00100000:1.0:1788509369.566470:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796758784 00000100:00100000:1.0:1788509369.566503:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788509369.566510:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796758784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.566545:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796758784:12345-0@lo:400:kworker.0 Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509369.566552:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788509369.566587:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796758784:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.566645:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796758912:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.568740:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509369.568861:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796759424:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.568948:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509369.568972:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788509369.568978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796759040:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.569003:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509369.571264:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796759424 00000100:00100000:3.0:1788509369.571278:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796759424 00000100:00100000:3.0:1788509369.574075:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788509369.574116:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796759424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509369.574249:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796759424:12345-0@lo:400:kworker.0 Request processed in 144us (5300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509369.574257:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788509369.574301:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509369.585055:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796758912 00000100:00100000:0.0:1788509369.585076:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796758912 00000100:00100000:0.0:1788509369.585152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796759040 00000100:00100000:0.0:1788509369.585155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796759040 00000100:00080000:0.0:1788509369.585180:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509369.585259:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788509369.585271:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796758912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509369.585384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796758912:12345-0@lo:400:kworker.0 Request processed in 115us (17469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509369.585392:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788509369.585414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788509369.585421:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796759040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509369.585452:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796759040:12345-0@lo:400:kworker.0 Request processed in 32us (16448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509369.585458:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788509369.585514:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796759552:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.585561:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788509369.585612:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788d500 x1875387796759424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509369.585627:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796759424:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.585640:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796758912:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.585680:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796759040:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.585706:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796759296:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.585738:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509369.585765:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788509369.585772:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796759168:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.585794:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509369.585806:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796759680:0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.585826:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509369.585847:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796759552 00000100:00100000:1.0:1788509369.585851:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796759552 00000100:00100000:1.0:1788509369.585894:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796759168 00000100:00100000:1.0:1788509369.585923:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796759168 00000100:00100000:1.0:1788509369.585940:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796759680 00000100:00100000:1.0:1788509369.585943:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796759680 00000100:00100000:1.0:1788509369.585959:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788509369.585966:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796759552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.586005:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796759552:12345-0@lo:400:kworker.0 Request processed in 39us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509369.586011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788509369.586042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788509369.586049:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796759168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.586080:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796759168:12345-0@lo:400:kworker.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509369.586087:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788509369.586099:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788509369.586105:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796759680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.586131:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796759680:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509369.586138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788509369.586162:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796759296 00000100:00100000:1.0:1788509369.586166:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796759296 00000100:00100000:1.0:1788509369.586198:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788509369.586205:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796759296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509369.586236:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796759296:12345-0@lo:400:kworker.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509369.586243:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788509369.586271:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788dc00 x1875387796759168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509369.586290:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796759168:0@lo:400:kworker.0 00010000:00080000:1.0:1788509369.586303:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788d180 x1875387796759680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509369.586323:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796759680:0@lo:400:kworker.0 00010000:00080000:1.0:1788509369.586334:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788ce00 x1875387796759296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509369.586343:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796759296:0@lo:400:kworker.0 00000100:00080000:1.0:1788509369.586370:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509369.586373:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509369.586376:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509369.586395:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796759552:0@lo:400:kworker.0 00000001:02000400:1.0:1788509369.987592:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 04:09:27 EDT 2026 00000100:00100000:2.0:1788509370.071069:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796759808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509370.071170:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509370.071259:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796759808 00000100:00100000:2.0:1788509370.071269:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796759808 00000100:00100000:2.0:1788509370.071341:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788509370.071365:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796759808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788509370.071404:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509370.071459:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796759808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509370.071466:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788509370.071579:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356d80 x1875387796759808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509370.071600:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796759808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509370.071722:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788509370.071733:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796759936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509370.071766:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509370.071803:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796759936 00000100:00100000:3.0:1788509370.071807:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796759936 00000100:00100000:3.0:1788509370.071832:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788509370.071838:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796759936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509370.071850:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509370.071881:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796759936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509370.071887:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788509370.071933:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787dc00 x1875387796759936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509370.071946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796759936:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788509370.198111:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509371.223479:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509371.672307:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509371.672400:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774674304 00000100:00100000:2.0:1788509371.672413:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774674304 00000100:00100000:2.0:1788509371.672490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:2.0:1788509371.672502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2409:x1875387774674304:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509371.672609:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2409:x1875387774674304:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509371.672618:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:1.0:1788509371.673937:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509371.675890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774674432 00000100:00100000:3.0:1788509371.675920:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774674432 00000100:00100000:3.0:1788509371.676006:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1788509371.676018:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2409:x1875387774674432:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509371.676125:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2409:x1875387774674432:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 109us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509371.676134:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00080000:1.0:1788509371.676987:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509371.679149:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509371.679655:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774674560 00000100:00100000:2.0:1788509371.679667:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774674560 00000100:00100000:2.0:1788509371.679747:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1788509371.679762:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774674560:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509371.679957:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774674560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 199us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509371.679965:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00080000:2.0:1788509371.679995:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788509372.247170:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509373.270182:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509374.166449:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509374.166482:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796760064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509374.166582:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509374.166662:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796760064 00000100:00100000:3.0:1788509374.166674:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796760064 00000100:00100000:3.0:1788509374.166796:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788509374.166810:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796760064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509374.166856:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509374.167020:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796760064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 211us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509374.167029:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788509374.167118:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796760064:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509374.294454:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509374.679370:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796760192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509374.679487:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509374.679578:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509374.679586:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796760320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509374.679615:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509374.679662:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796760192 00000100:00100000:3.0:1788509374.679672:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796760192 00000100:00100000:3.0:1788509374.679732:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788509374.679743:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796760192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509374.679790:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509374.679844:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796760192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509374.679852:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788509374.680250:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796760448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509374.680314:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509374.680365:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796760320 00000100:00100000:1.0:1788509374.680371:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796760320 00000100:00100000:1.0:1788509374.680413:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796760448 00000100:00100000:1.0:1788509374.680416:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796760448 00000100:00100000:1.0:1788509374.680435:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788509374.680456:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796760320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509374.680481:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509374.680516:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796760320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509374.680523:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788509374.680553:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788509374.680560:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796760448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509374.680570:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509374.680597:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796760448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509374.680603:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788509374.680622:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788509374.680659:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87dddc00 x1875387796760448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509374.680680:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796760448:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788509374.681179:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787e300 x1875387796760320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509374.681196:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796760320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509374.681212:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796760192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509374.681460:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796760832:0@lo:400:kworker.0 00000100:00100000:2.0:1788509374.681511:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509374.681556:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796761344:0@lo:400:kworker.0 00000100:00100000:2.0:1788509374.681584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509374.681606:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788509374.681612:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796760704:0@lo:400:kworker.0 00000100:00100000:2.0:1788509374.681635:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509374.681650:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796761216:0@lo:400:kworker.0 00000100:00100000:2.0:1788509374.681672:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509374.681705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796760832 00000100:00100000:2.0:1788509374.681712:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796760832 00000100:00100000:2.0:1788509374.681750:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796760704 00000100:00100000:2.0:1788509374.681754:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796760704 00000100:00100000:2.0:1788509374.681775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788509374.681783:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796760832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509374.681830:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796760832:12345-0@lo:400:kworker.0 Request processed in 47us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509374.681837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788509374.681854:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788509374.681859:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796760704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509374.681886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796760704:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509374.681891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788509374.681941:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796761344 00000100:00100000:2.0:1788509374.681945:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796761344 00000100:00100000:2.0:1788509374.681973:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796761216 00000100:00100000:2.0:1788509374.681976:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796761216 00000100:00100000:2.0:1788509374.681993:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788509374.681999:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796761344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509374.682041:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796761344:12345-0@lo:400:kworker.0 Request processed in 42us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509374.682047:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788509374.685554:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796760960:0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.685665:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509374.685800:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796760960 00000100:00100000:1.0:1788509374.685810:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796760960 00000100:00100000:2.0:1788509374.685913:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788509374.685931:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796761216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509374.686001:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796761216:12345-0@lo:400:kworker.0 Request processed in 76us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509374.686009:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788509374.686970:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796760576:0@lo:400:kworker.0 00000100:00100000:0.0:1788509374.687037:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509374.687566:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796761472:0@lo:400:kworker.0 00000100:00100000:0.0:1788509374.687585:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796761088:0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.687614:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509374.687671:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796761472 00000100:00100000:3.0:1788509374.687680:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796761472 00000100:00100000:0.0:1788509374.687695:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509374.687717:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796761600:0@lo:400:kworker.0 00000100:00100000:1.0:1788509374.687799:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796761088 00000100:00100000:1.0:1788509374.687803:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796761088 00000100:00100000:0.0:1788509374.693220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788509374.693324:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509374.693332:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509374.693338:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509374.693614:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796760576 00000100:00100000:0.0:1788509374.693627:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796760576 00000100:00100000:0.0:1788509374.693699:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788509374.693710:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796760576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509374.693867:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796760576:12345-0@lo:400:kworker.0 Request processed in 159us (6828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509374.693894:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788509374.693994:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796760576:0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.694919:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796761600 00000100:00100000:3.0:1788509374.694930:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796761600 00000100:00100000:3.0:1788509374.694988:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788509374.694999:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796760960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.695104:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796760960:12345-0@lo:400:kworker.0 Request processed in 107us (9439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509374.695112:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788509374.695147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788509374.695153:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796761472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.695186:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796761472:12345-0@lo:400:kworker.0 Request processed in 34us (7573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509374.695192:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788509374.695205:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788509374.695211:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796761600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.695243:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796761600:12345-0@lo:400:kworker.0 Request processed in 33us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509374.695249:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788509374.695310:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796760960:0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.695325:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796761472:0@lo:400:kworker.0 00000100:00080000:0.0:1788509374.695488:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788509374.695520:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781500 x1875387796761600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509374.695532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796761600:0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.695651:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796760704:0@lo:400:kworker.0 00010000:00080000:3.0:1788509374.695686:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87780000 x1875387796761216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509374.695696:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796761216:0@lo:400:kworker.0 00000100:00100000:3.0:1788509374.695710:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796760832:0@lo:400:kworker.0 00010000:00080000:3.0:1788509374.695721:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87783b80 x1875387796761344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509374.695729:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796761344:0@lo:400:kworker.0 00000100:00100000:1.0:1788509374.697453:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788509374.697479:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796761088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509374.697611:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796761088:12345-0@lo:400:kworker.0 Request processed in 145us (9973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509374.697620:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1788509374.697712:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87783100 x1875387796761088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509374.697728:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796761088:0@lo:400:kworker.0 00000100:00100000:0.0:1788509375.190220:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796761728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509375.190330:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509375.190527:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796761728 00000100:00100000:2.0:1788509375.190538:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796761728 00000100:00100000:2.0:1788509375.190603:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788509375.190623:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796761728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788509375.190661:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509375.190718:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796761728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509375.190725:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788509375.190772:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd891f8a80 x1875387796761728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509375.190793:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796761728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509375.191742:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509375.191757:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796761856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509375.192309:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509375.197151:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796761856 00000100:00100000:0.0:1788509375.197172:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796761856 00000100:00100000:2.0:1788509375.197759:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788509375.197773:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796761856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788509375.197810:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509375.197979:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796761856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 208us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509375.197988:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788509375.198123:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788ea00 x1875387796761856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509375.198151:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796761856:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788509375.318112:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509376.346249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509376.793323:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509376.793366:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509376.793395:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509376.793454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774674688 00000100:00100000:1.0:1788509376.793463:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774674688 00000100:00100000:2.0:1788509376.793654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774674944 00000100:00100000:2.0:1788509376.793659:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774674944 00000100:00100000:1.0:1788509376.793707:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 282 00000100:00100000:1.0:1788509376.793717:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2410:x1875387774674688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509376.793785:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2410:x1875387774674688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509376.793793:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 282 00000100:00100000:3.0:1788509376.797126:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774674816 00000100:00100000:3.0:1788509376.797141:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774674816 00000100:00100000:2.0:1788509376.806771:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1788509376.806788:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774674944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509376.806870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774674944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (13503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509376.806878:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:3.0:1788509376.811787:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:3.0:1788509376.811801:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774674816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509376.811880:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774674816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (18483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509376.811888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00080000:0.0:1788509376.815566:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509376.815623:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788509377.366836:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509378.390319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509379.288935:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796761984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509379.289004:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509379.289075:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796761984 00000100:00100000:3.0:1788509379.289082:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796761984 00000100:00100000:3.0:1788509379.289124:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788509379.289133:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796761984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509379.289168:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509379.289211:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796761984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509379.289218:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788509379.289289:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796761984:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788509379.414998:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509379.798052:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509379.798072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796762112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509379.798134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509379.798193:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796762112 00000100:00100000:1.0:1788509379.798200:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796762112 00000100:00100000:1.0:1788509379.798263:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788509379.798275:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796762112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509379.798302:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509379.798346:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796762112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509379.798354:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788509379.798388:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788509379.798426:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87dddc00 x1875387796762112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509379.798442:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796762112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509379.801928:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796762240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509379.802009:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509379.802071:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796762240 00000100:00100000:1.0:1788509379.802078:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796762240 00000100:00100000:1.0:1788509379.802129:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788509379.802136:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796762240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509379.802158:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509379.802197:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796762240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509379.802204:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788509379.802235:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788509379.802272:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87dddc00 x1875387796762240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509379.802290:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796762240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509379.803986:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509379.803999:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796762368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509379.804049:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509379.804082:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796762368 00000100:00100000:2.0:1788509379.804087:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796762368 00000100:00100000:2.0:1788509379.804120:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788509379.804127:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796762368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509379.804154:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788509379.804189:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796762368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509379.804195:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788509379.804230:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796762368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509379.807165:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796762496:0@lo:400:kworker.0 00000100:00100000:2.0:1788509379.807225:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509379.814306:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796762496 00000100:00100000:2.0:1788509379.814319:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796762496 00000100:00100000:2.0:1788509379.814375:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788509379.814384:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796762496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509379.814460:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796762496:12345-0@lo:400:kworker.0 Request processed in 77us (7234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509379.814467:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788509379.814508:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796762624:0@lo:400:kworker.0 00000100:00100000:2.0:1788509379.814541:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509379.814640:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796762624 00000100:00100000:2.0:1788509379.814644:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796762624 00000100:00100000:2.0:1788509379.814675:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788509379.814682:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796762624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509379.814721:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796762624:12345-0@lo:400:kworker.0 Request processed in 40us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509379.814728:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788509379.814849:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796762624:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.816144:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796762752:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.816191:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509379.816253:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796762752 00000100:00100000:0.0:1788509379.816259:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796762752 00000100:00100000:0.0:1788509379.816297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788509379.816305:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796762752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.816348:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796762752:12345-0@lo:400:kworker.0 Request processed in 44us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509379.816356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788509379.816395:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796762752:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.816430:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796762880:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.816452:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509379.816476:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796762880 00000100:00100000:0.0:1788509379.816481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796762880 00000100:00100000:0.0:1788509379.816513:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788509379.816520:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796762880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.816553:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796762880:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509379.816559:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788509379.822208:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796762880:0@lo:400:kworker.0 00000100:00080000:0.0:1788509379.822260:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509379.822306:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509379.822316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796763008:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.822372:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509379.822411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796763008 00000100:00100000:0.0:1788509379.822417:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796763008 00000100:00100000:0.0:1788509379.822466:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788509379.822475:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796763008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.822539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796763008:12345-0@lo:400:kworker.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509379.822547:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1788509379.824179:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788d180 x1875387796763008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509379.824194:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796763008:0@lo:400:kworker.0 00000100:00080000:0.0:1788509379.824228:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509379.824279:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796763136:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.824323:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509379.824360:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796763136 00000100:00100000:0.0:1788509379.824365:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796763136 00000100:00100000:0.0:1788509379.824404:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788509379.824412:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796763136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.824449:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796763136:12345-0@lo:400:kworker.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509379.824455:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788509379.824482:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788d180 x1875387796763136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509379.824491:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796763136:0@lo:400:kworker.0 00000100:00080000:0.0:1788509379.824502:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509379.824524:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796763264:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.824545:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509379.827850:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796763264 00000100:00100000:0.0:1788509379.827866:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796763264 00000100:00100000:0.0:1788509379.828028:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788509379.828048:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796763264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.828210:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796763264:12345-0@lo:400:kworker.0 Request processed in 163us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509379.828218:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788509379.828258:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788509379.828291:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb788d180 x1875387796763264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509379.828306:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796763264:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.828363:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796763392:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.828398:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509379.828431:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796763392 00000100:00100000:0.0:1788509379.828435:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796763392 00000100:00100000:0.0:1788509379.828467:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788509379.828473:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796763392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.828507:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796763392:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509379.828513:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788509379.828540:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796763392:0@lo:400:kworker.0 00000100:00080000:0.0:1788509379.828554:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509379.828577:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509379.828584:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796763520:0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.828608:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509379.828629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796763520 00000100:00100000:0.0:1788509379.828633:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796763520 00000100:00100000:0.0:1788509379.828660:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788509379.828667:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796763520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509379.828708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796763520:12345-0@lo:400:kworker.0 Request processed in 41us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509379.828715:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1788509379.828742:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356d80 x1875387796763520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509379.831877:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796763520:0@lo:400:kworker.0 00000100:00080000:0.0:1788509379.831935:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509379.832656:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796762496:0@lo:400:kworker.0 00000100:00100000:3.0:1788509380.310157:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509380.310179:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796763648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509380.310251:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509380.310931:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796763648 00000100:00100000:2.0:1788509380.310939:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796763648 00000100:00100000:2.0:1788509380.310996:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788509380.311005:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796763648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788509380.311034:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509380.311089:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796763648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509380.311096:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788509380.311135:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119d180 x1875387796763648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509380.311166:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796763648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509380.311613:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796763776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509380.311653:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509380.311928:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796763776 00000100:00100000:0.0:1788509380.311934:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796763776 00000100:00100000:0.0:1788509380.311963:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788509380.311970:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796763776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509380.311985:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509380.312021:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796763776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509380.312027:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788509380.312127:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87780000 x1875387796763776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509380.312142:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796763776:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788509380.439136:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509381.462944:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509381.908238:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509381.908288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509381.908346:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509381.908399:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774675072 00000100:00100000:3.0:1788509381.908410:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774675072 00000100:00100000:3.0:1788509381.908488:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 284 00000100:00100000:0.0:1788509381.908491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774675200 00000100:00100000:0.0:1788509381.908497:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774675200 00000100:00100000:3.0:1788509381.908501:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2408:x1875387774675072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509381.908545:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774675328 00000100:00100000:0.0:1788509381.908549:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774675328 00000100:00100000:3.0:1788509381.908573:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2408:x1875387774675072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509381.908582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 284 00000100:00100000:0.0:1788509381.908591:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1788509381.908603:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774675200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509381.908640:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774675200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509381.908647:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1788509381.908665:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:0.0:1788509381.908672:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774675328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509381.908709:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774675328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509381.908730:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00080000:0.0:1788509381.908753:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509381.908757:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788509382.486352:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509383.510128:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509384.407441:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796763904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509384.407519:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509384.407549:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796763904 00000100:00100000:3.0:1788509384.407556:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796763904 00000100:00100000:3.0:1788509384.407599:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788509384.407608:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796763904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509384.407640:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509384.407686:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796763904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509384.407693:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788509384.407736:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796763904:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509384.534035:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788509384.706813:0:11995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:09:42 (1788509382) === 00000100:00100000:0.0:1788509384.918104:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509384.918134:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796764032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509384.918197:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509384.918415:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796764032 00000100:00100000:2.0:1788509384.918424:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796764032 00000100:00100000:2.0:1788509384.918479:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788509384.918497:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796764032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509384.918531:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788509384.918594:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796764032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509384.918601:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788509384.919356:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796764160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509384.919407:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509384.919460:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796764032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509384.919500:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796764160 00000100:00100000:1.0:1788509384.919505:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796764160 00000100:00100000:1.0:1788509384.919782:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788509384.919792:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796764160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509384.919814:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509384.919861:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796764160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509384.919868:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788509384.919919:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788509384.919979:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87d48e00 x1875387796764160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509384.919994:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796764160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509384.920082:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796764288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509384.920125:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509384.920261:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796764672:0@lo:400:kworker.0 00000100:00100000:0.0:1788509384.920294:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509384.920314:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509384.920334:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796764544:0@lo:400:kworker.0 00000100:00100000:0.0:1788509384.920356:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509384.920382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796764672 00000100:00100000:0.0:1788509384.920387:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796764672 00000100:00100000:0.0:1788509384.920417:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796764544 00000100:00100000:0.0:1788509384.920420:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796764544 00000100:00100000:0.0:1788509384.920438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788509384.920445:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796764672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509384.920493:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796764672:12345-0@lo:400:kworker.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509384.920509:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788509384.920524:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788509384.920529:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796764544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509384.920568:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796764544:12345-0@lo:400:kworker.0 Request processed in 38us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509384.920574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788509384.920607:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796764544:0@lo:400:kworker.0 00000100:00100000:0.0:1788509384.920616:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796764672:0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921011:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796764800:0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921040:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509384.921060:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796765312:0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921079:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509384.921097:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788509384.921102:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796764416:0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921137:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509384.921166:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796764928:0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921185:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509384.921197:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796765440:0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921224:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509384.921247:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796765312 00000100:00100000:2.0:1788509384.921250:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796765312 00000100:00100000:2.0:1788509384.921285:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788509384.921291:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796765312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921437:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796765312:12345-0@lo:400:kworker.0 Request processed in 146us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509384.921444:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788509384.921464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796764416 00000100:00100000:2.0:1788509384.921468:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796764416 00000100:00100000:2.0:1788509384.921621:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788509384.921629:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796764416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921661:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796764416:12345-0@lo:400:kworker.0 Request processed in 34us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509384.921667:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788509384.921697:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796764928 00000100:00100000:2.0:1788509384.921700:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796764928 00000100:00100000:2.0:1788509384.921723:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796765440 00000100:00100000:2.0:1788509384.921726:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796765440 00000100:00100000:2.0:1788509384.921747:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788509384.921753:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796764928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921783:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796764928:12345-0@lo:400:kworker.0 Request processed in 30us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509384.921790:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788509384.921811:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788509384.921816:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796765440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921845:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796765440:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509384.921852:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1788509384.921873:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509384.921878:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509384.921923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796764416:0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921936:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796764928:0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.921946:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796765440:0@lo:400:kworker.0 00010000:00080000:2.0:1788509384.921957:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119c700 x1875387796765312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509384.921967:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796765312:0@lo:400:kworker.0 00000100:00100000:1.0:1788509384.923295:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796764288 00000100:00100000:1.0:1788509384.923303:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796764288 00000100:00100000:1.0:1788509384.923404:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788509384.923413:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796764288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509384.923433:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509384.923508:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796764288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (3381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509384.923515:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788509384.923633:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787a300 x1875387796764288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509384.923650:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796764288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509384.924282:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796765184:0@lo:400:kworker.0 00000100:00100000:0.0:1788509384.924337:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509384.924368:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788509384.924374:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796765056:0@lo:400:kworker.0 00000100:00100000:0.0:1788509384.924395:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509384.924410:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796765568:0@lo:400:kworker.0 00000100:00100000:0.0:1788509384.924428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509384.925222:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796765056 00000100:00100000:2.0:1788509384.925230:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796765056 00000100:00100000:2.0:1788509384.925277:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796765568 00000100:00100000:2.0:1788509384.925280:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796765568 00000100:00100000:2.0:1788509384.925304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788509384.925312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796765056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.925383:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796765056:12345-0@lo:400:kworker.0 Request processed in 72us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509384.925390:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788509384.925406:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788509384.925412:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796765568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509384.925440:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796765568:12345-0@lo:400:kworker.0 Request processed in 29us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509384.925460:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788509384.925477:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509384.925660:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788509384.925698:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119ed80 x1875387796765056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509384.925710:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796765056:0@lo:400:kworker.0 00010000:00080000:2.0:1788509384.925721:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7898700 x1875387796765568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509384.925728:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796765568:0@lo:400:kworker.0 00000100:00100000:1.0:1788509384.925836:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796765184 00000100:00100000:1.0:1788509384.925841:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796765184 00000100:00100000:1.0:1788509384.925885:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788509384.925892:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796765184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509384.925957:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796765184:12345-0@lo:400:kworker.0 Request processed in 65us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509384.925964:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788509384.926005:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119c000 x1875387796765184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509384.926014:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796765184:0@lo:400:kworker.0 00000100:00080000:2.0:1788509384.926422:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509384.927724:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796764800 00000100:00100000:3.0:1788509384.927733:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796764800 00000100:00100000:3.0:1788509384.927820:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788509384.927829:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796764800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509384.927929:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796764800:12345-0@lo:400:kworker.0 Request processed in 101us (6888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509384.927948:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788509384.928024:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796764800:0@lo:400:kworker.0 00000100:00100000:1.0:1788509385.431078:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796765824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509385.431150:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509385.431249:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796765696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788509385.431275:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509385.431354:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796765824 00000100:00100000:2.0:1788509385.431362:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796765824 00000100:00100000:2.0:1788509385.431411:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796765696 00000100:00100000:2.0:1788509385.431414:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796765696 00000100:00100000:2.0:1788509385.431432:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788509385.431440:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796765824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788509385.431469:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509385.431519:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796765824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.431526:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788509385.431554:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788509385.431561:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796765696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788509385.431570:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509385.431596:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796765696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.431619:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788509385.431657:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781500 x1875387796765824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509385.431675:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796765824:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788509385.432151:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7898700 x1875387796765696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509385.432166:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796765696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509385.496075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.496187:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774675456 00000100:00100000:1.0:1788509385.496208:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774675456 00000100:00100000:1.0:1788509385.496272:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 286 00000100:00100000:1.0:1788509385.496282:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:8728:x1875387774675456:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788509385.496297:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509385.496314:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8800/0xe5156b86310dd95c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552f99 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509385.496342:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8800/0xe5156b86310dd95c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f99 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509385.496370:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8800/0xe5156b86310dd95c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f99 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509385.496380:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8800, rc 0) 00000100:00100000:1.0:1788509385.496444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8728:x1875387774675456:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 163us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.496461:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 286 00000100:00100000:3.0:1788509385.501937:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.502027:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774675584 00000100:00100000:2.0:1788509385.502036:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774675584 00000100:00100000:2.0:1788509385.502085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 287 00000100:00100000:2.0:1788509385.502096:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8728:x1875387774675584:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788509385.502268:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8728:x1875387774675584:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 174us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.502276:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 287 00000100:00100000:0.0:1788509385.506188:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.506293:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774675712 00000100:00100000:1.0:1788509385.506304:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774675712 00000100:00100000:1.0:1788509385.506364:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00100000:1.0:1788509385.506374:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8728:x1875387774675712:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788509385.506614:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8728:x1875387774675712:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 241us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.506623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00100000:3.0:1788509385.513994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.514278:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774675840 00000100:00100000:1.0:1788509385.514290:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774675840 00000100:00100000:1.0:1788509385.514345:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 289 00000100:00100000:1.0:1788509385.514356:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8732:x1875387774675840:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788509385.514525:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8732:x1875387774675840:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 170us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.514542:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 289 00000100:00100000:0.0:1788509385.556072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.556164:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774675968 00000100:00100000:1.0:1788509385.556174:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774675968 00000100:00100000:1.0:1788509385.556243:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00100000:1.0:1788509385.556253:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8732:x1875387774675968:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788509385.556417:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8732:x1875387774675968:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 166us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.556426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 290 00010000:00010000:1.0:1788509385.558940:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509385.566299:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509385.568495:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774676096 00000100:00100000:3.0:1788509385.568510:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774676096 00000100:00100000:3.0:1788509385.568593:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 291 00000100:00100000:3.0:1788509385.568603:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8732:x1875387774676096:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788509385.568768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8732:x1875387774676096:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 166us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509385.568776:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 291 00000100:00100000:3.0:1788509385.579333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.579497:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774676224 00000100:00100000:2.0:1788509385.579508:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774676224 00000100:00100000:2.0:1788509385.579575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 292 00000100:00100000:2.0:1788509385.579585:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:8728:x1875387774676224:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788509385.579611:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509385.579630:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552fca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509385.579658:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fca expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509385.579669:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fca expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509385.579679:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226600, rc 0) 00000100:00100000:2.0:1788509385.579813:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:8728:x1875387774676224:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 228us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.579820:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 292 00000100:00100000:0.0:1788509385.593356:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.593441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774676352 00000100:00100000:1.0:1788509385.593451:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774676352 00000100:00100000:1.0:1788509385.593505:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 293 00000100:00100000:1.0:1788509385.593514:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:8728:x1875387774676352:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788509385.593548:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788509385.593573:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788509385.593577:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788509385.593579:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788509385.593582:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788509385.593584:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788509385.597587:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:8728:x1875387774676352:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 4064us (4230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.598368:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 293 00000100:00100000:3.0:1788509385.609248:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.609341:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774676480 00000100:00100000:2.0:1788509385.609350:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774676480 00000100:00100000:2.0:1788509385.609403:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 294 00000100:00100000:2.0:1788509385.609411:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:8728:x1875387774676480:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788509385.609426:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509385.609442:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647552fd1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509385.609469:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509385.609480:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509385.609489:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227e00, rc 0) 00000100:00100000:2.0:1788509385.609547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8728:x1875387774676480:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 137us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.609554:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 294 00000100:00100000:0.0:1788509385.614261:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.614772:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774676608 00000100:00100000:1.0:1788509385.614782:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774676608 00000100:00100000:1.0:1788509385.614843:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:1.0:1788509385.614854:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8728:x1875387774676608:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788509385.615035:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8728:x1875387774676608:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 182us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.615044:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:0.0:1788509385.626445:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.626677:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774676736 00000100:00100000:1.0:1788509385.626687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774676736 00000100:00100000:1.0:1788509385.626750:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 296 00000100:00100000:1.0:1788509385.626760:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8728:x1875387774676736:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788509385.626960:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8728:x1875387774676736:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 200us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.626968:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 296 00000100:00100000:3.0:1788509385.638134:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.638247:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774676864 00000100:00100000:2.0:1788509385.638258:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774676864 00000100:00100000:2.0:1788509385.638319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 297 00000100:00100000:2.0:1788509385.638330:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8736:x1875387774676864:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788509385.638492:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8736:x1875387774676864:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 163us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.638509:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 297 00000100:00100000:0.0:1788509385.648295:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.648387:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774676992 00000100:00100000:2.0:1788509385.648398:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774676992 00000100:00100000:2.0:1788509385.648456:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 298 00000100:00100000:2.0:1788509385.648466:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8736:x1875387774676992:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788509385.648662:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:8736:x1875387774676992:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 196us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.648670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 298 00000100:00100000:0.0:1788509385.652495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.653313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774677120 00000100:00100000:2.0:1788509385.653325:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774677120 00000100:00100000:2.0:1788509385.653380:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788509385.653388:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875387774677120:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788509385.653416:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e2b56a23-ddae-407e-b137-3c943d18cb4f@192.168.203.12@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1788509385.653448:0:6522:0:(genops.c:1385:class_connect()) connect: client e2b56a23-ddae-407e-b137-3c943d18cb4f, cookie 0xe5156b86310dd971 00000004:00100000:2.0:1788509385.653474:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788509385.654734:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8bcdb786b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509385.654809:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2406:x1875387774677120:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 1420us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.654823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788509385.665000:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509385.665057:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.665151:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774677376 00000100:00100000:2.0:1788509385.665162:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774677376 00000100:00100000:2.0:1788509385.665242:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774677248 00000100:00100000:2.0:1788509385.665250:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774677248 00000100:00100000:2.0:1788509385.665279:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1788509385.665289:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774677376:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509385.665370:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774677376:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.665378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1788509385.665396:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1788509385.665403:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774677248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509385.665430:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774677248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.665436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00080000:3.0:1788509385.665630:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509385.665636:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509385.667380:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.667460:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774677632 00000100:00100000:2.0:1788509385.667468:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774677632 00000100:00100000:2.0:1788509385.667516:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788509385.667524:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875387774677632:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788509385.667566:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e2b56a23-ddae-407e-b137-3c943d18cb4f@192.168.203.12@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1788509385.667764:0:6520:0:(genops.c:1385:class_connect()) connect: client e2b56a23-ddae-407e-b137-3c943d18cb4f, cookie 0xe5156b86310dd978 00000004:00100000:2.0:1788509385.667792:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788509385.667938:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8bcdb7869000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509385.668056:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2406:x1875387774677632:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 530us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.668065:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788509385.684293:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509385.684507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.694336:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774677504 00000100:00100000:1.0:1788509385.694350:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774677504 00000100:00100000:1.0:1788509385.694482:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774677888 00000100:00100000:1.0:1788509385.694486:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774677888 00000100:00100000:1.0:1788509385.694515:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788509385.694526:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+7:0:x1875387774677504:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788509385.694569:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788509385.697811:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+7:0:x1875387774677504:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 3276us (13516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.697824:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788509385.697885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788509385.697912:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:8728:x1875387774677888:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788509385.697942:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788509385.697970:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:8728:x1875387774677888:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 79us (13464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.697976:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00080000:3.0:1788509385.700611:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509385.708970:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509385.709170:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774677760 00000100:00100000:1.0:1788509385.709179:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774677760 00000100:00100000:1.0:1788509385.709264:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788509385.709274:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:0:x1875387774677760:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788509385.709328:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509385.709422:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:0:x1875387774677760:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 148us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509385.709430:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00080000:2.0:1788509385.710263:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509385.710997:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509385.711083:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774678016 00000100:00100000:0.0:1788509385.711091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774678016 00000100:00100000:0.0:1788509385.711152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788509385.711162:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:8728:x1875387774678016:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788509385.711248:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:8728:x1875387774678016:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509385.711256:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788509385.721291:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.721437:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774678144 00000100:00100000:2.0:1788509385.721447:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774678144 00000100:00100000:2.0:1788509385.721502:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788509385.721511:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875387774678144:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788509385.721566:0:8756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e2b56a23-ddae-407e-b137-3c943d18cb4f@192.168.203.12@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1788509385.721595:0:8756:0:(genops.c:1385:class_connect()) connect: client e2b56a23-ddae-407e-b137-3c943d18cb4f, cookie 0xe5156b86310dd97f 00002000:00100000:2.0:1788509385.721620:0:8756:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e2b56a23-ddae-407e-b137-3c943d18cb4f/ffff8bcdb786f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788509385.721632:0:8756:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788509385.721708:0:8756:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788509385.721737:0:8756:0:(import.c:65:import_set_state_nolock()) ffff8bcdb7868000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509385.723296:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2406:x1875387774678144:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 1775us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.723310:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788509385.723466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509385.723622:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509385.723676:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774678272 00000100:00100000:2.0:1788509385.723683:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774678272 00000100:00100000:2.0:1788509385.723714:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788509385.723719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1875387774678272:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788509385.723770:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e2b56a23-ddae-407e-b137-3c943d18cb4f@192.168.203.12@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1788509385.723796:0:8436:0:(genops.c:1385:class_connect()) connect: client e2b56a23-ddae-407e-b137-3c943d18cb4f, cookie 0xe5156b86310dd986 00002000:00100000:2.0:1788509385.723805:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e2b56a23-ddae-407e-b137-3c943d18cb4f/ffff8bcdb786e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788509385.723817:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788509385.724263:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788509385.724296:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8bcdb7869800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509385.725257:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774678400 00000100:00100000:0.0:1788509385.725266:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774678400 00000100:00100000:0.0:1788509385.725314:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788509385.725321:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:8728:x1875387774678400:12345-192.168.203.12@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788509385.728011:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2406:x1875387774678272:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 4278us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509385.728026:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788509385.728329:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:8728:x1875387774678400:12345-192.168.203.12@tcp:900:mount.lustre.0 Request processed in 3005us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509385.728339:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788509385.733459:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509385.733550:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774678528 00000100:00100000:3.0:1788509385.733561:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774678528 00000100:00100000:3.0:1788509385.733679:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788509385.733691:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:8728:x1875387774678528:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788509385.733783:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788509385.735693:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:8728:x1875387774678528:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 1995us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509385.735721:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00010000:00010000:1.0:1788509386.582167:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509387.608972:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509388.646930:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509389.527725:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509389.527750:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796765952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509389.527834:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509389.527996:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796765952 00000100:00100000:2.0:1788509389.528004:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796765952 00000100:00100000:2.0:1788509389.528050:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788509389.528059:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796765952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509389.528319:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788509389.528415:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796765952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 356us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509389.528422:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788509389.540617:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796765952:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788509389.660360:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509390.038062:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796766336:0@lo:400:kworker.0 00000100:00100000:1.0:1788509390.038139:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038196:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796766080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509390.038232:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038286:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796766208:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038326:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038351:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796766720:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038390:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796767232:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038413:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038430:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796767744:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038450:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038473:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788509390.038479:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796766848:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038506:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796766464:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038527:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038543:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796766976:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038566:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796766592:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038595:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796766080 00000100:00100000:3.0:1788509390.038601:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796766080 00000100:00100000:3.0:1788509390.038636:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796766720 00000100:00100000:3.0:1788509390.038639:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796766720 00000100:00100000:3.0:1788509390.038665:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796766464 00000100:00100000:1.0:1788509390.038671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796766208 00000100:00100000:1.0:1788509390.038675:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796766208 00000100:00100000:3.0:1788509390.038678:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796766464 00000100:00100000:3.0:1788509390.038695:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788509390.038704:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796766080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509390.038748:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509390.038791:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796766080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509390.038798:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788509390.038812:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788509390.038815:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788509390.038817:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796766720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509390.038820:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796766208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038846:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796766720:12345-0@lo:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509390.038846:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796766208:12345-0@lo:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509390.038852:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788509390.038852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788509390.038863:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788509390.038868:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796766464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038891:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796766464:12345-0@lo:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509390.038891:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038923:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788509390.038928:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796767488:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038945:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796767232 00000100:00100000:3.0:1788509390.038948:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796767232 00000100:00100000:1.0:1788509390.038950:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.038974:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796767744 00000100:00100000:3.0:1788509390.038977:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796767744 00000100:00100000:1.0:1788509390.038982:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796766464:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.038991:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788509390.038996:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796767232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509390.039004:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509390.039020:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796767360:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.039025:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796767232:12345-0@lo:400:kworker.0 Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509390.039031:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788509390.039039:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.039042:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788509390.039053:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796767744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509390.039058:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796766080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509390.039066:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796766208:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.039078:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796767744:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509390.039081:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796766720:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.039084:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788509390.039093:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7899500 x1875387796767232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509390.039102:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796767232:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.039105:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.039118:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796767104:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.039138:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.039153:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796767616:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.039182:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.039206:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796767104 00000100:00100000:3.0:1788509390.039211:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796767104 00000100:00100000:3.0:1788509390.039228:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796767616 00000100:00100000:3.0:1788509390.039231:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796767616 00000100:00100000:3.0:1788509390.039243:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788509390.039249:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796767104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.039282:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796767104:12345-0@lo:400:kworker.0 Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509390.039288:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788509390.039299:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788509390.039304:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796767616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.039343:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796767616:12345-0@lo:400:kworker.0 Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509390.039349:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788509390.039374:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7898e00 x1875387796767104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509390.039383:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796767104:0@lo:400:kworker.0 00010000:00080000:3.0:1788509390.039402:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7898700 x1875387796767616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509390.039410:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796767616:0@lo:400:kworker.0 00000100:00100000:2.0:1788509390.039917:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796766336 00000100:00100000:2.0:1788509390.039924:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796766336 00000100:00100000:2.0:1788509390.039950:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796766976 00000100:00100000:2.0:1788509390.039953:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796766976 00000100:00100000:2.0:1788509390.039966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796767488 00000100:00100000:2.0:1788509390.039969:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796767488 00000100:00100000:2.0:1788509390.039981:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796766848 00000100:00100000:2.0:1788509390.039985:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796766848 00000100:00100000:2.0:1788509390.039995:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796767360 00000100:00100000:2.0:1788509390.039998:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796767360 00000100:00100000:2.0:1788509390.040010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796766592 00000100:00100000:2.0:1788509390.040014:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796766592 00000100:00100000:2.0:1788509390.040029:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788509390.040036:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796766336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509390.040098:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796766336:12345-0@lo:400:kworker.0 Request processed in 62us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509390.040105:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788509390.040129:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788509390.040134:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796766976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509390.040179:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796766976:12345-0@lo:400:kworker.0 Request processed in 44us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509390.040194:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788509390.040207:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788509390.040212:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796767488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509390.040242:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796767488:12345-0@lo:400:kworker.0 Request processed in 30us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509390.040248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788509390.040258:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788509390.040263:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796766848:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788509390.040270:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119d880 x1875387796767744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509390.040283:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796767744:0@lo:400:kworker.0 00000100:00100000:2.0:1788509390.040287:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796766848:12345-0@lo:400:kworker.0 Request processed in 24us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509390.040292:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788509390.040303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788509390.040309:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796767360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509390.040346:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796767360:12345-0@lo:400:kworker.0 Request processed in 38us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509390.040353:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788509390.040363:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788509390.040368:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796766592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509390.040398:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796766592:12345-0@lo:400:kworker.0 Request processed in 29us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509390.040403:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788509390.040423:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509390.040427:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509390.040429:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788509390.040431:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509390.040436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796766848:0@lo:400:kworker.0 00000100:00100000:1.0:1788509390.040447:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796767360:0@lo:400:kworker.0 00010000:00080000:2.0:1788509390.040462:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7899c00 x1875387796766976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509390.040472:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796766976:0@lo:400:kworker.0 00010000:00080000:2.0:1788509390.040482:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb789a300 x1875387796767488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509390.040490:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796767488:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.042716:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796766592:0@lo:400:kworker.0 00000100:00100000:3.0:1788509390.042756:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796767872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509390.042811:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.042856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796766336:0@lo:400:kworker.0 00000100:00100000:0.0:1788509390.042984:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796767872 00000100:00100000:0.0:1788509390.042992:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796767872 00000100:00100000:0.0:1788509390.043042:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788509390.043051:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796767872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788509390.043078:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509390.043133:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796767872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509390.043151:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788509390.043193:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787a300 x1875387796767872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509390.043207:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796767872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509390.044241:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509390.044254:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796768000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509390.044301:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509390.044793:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796768000 00000100:00100000:1.0:1788509390.044800:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796768000 00000100:00100000:1.0:1788509390.044853:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788509390.044862:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796768000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509390.044883:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509390.044972:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796768000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509390.044979:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788509390.045077:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87d4a680 x1875387796768000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509390.045095:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796768000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509390.550227:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509390.552369:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509390.552392:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796768256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509390.552483:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509390.552608:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796768256 00000100:00100000:3.0:1788509390.552616:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796768256 00000100:00100000:3.0:1788509390.552672:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788509390.552682:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796768256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509390.552709:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509390.552753:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796768256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509390.552760:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788509390.552843:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5ce00 x1875387796768256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509390.552861:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796768256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509390.553062:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796768128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788509390.553093:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509390.556348:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796768128 00000100:00100000:0.0:1788509390.556364:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796768128 00000100:00100000:0.0:1788509390.556433:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788509390.556445:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796768128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509390.556471:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509390.556699:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796768128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 256us (3604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509390.556707:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788509390.557991:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119c000 x1875387796768128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509390.558016:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796768128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788509390.679150:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509391.133034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509391.133075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509391.133114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509391.133156:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509391.133186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509391.133202:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509391.133223:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509391.133246:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774678912 00000100:00100000:0.0:1788509391.133255:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774678912 00000100:00100000:0.0:1788509391.133303:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774679168 00000100:00100000:0.0:1788509391.133306:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774679168 00000100:00100000:0.0:1788509391.133318:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774678784 00000100:00100000:0.0:1788509391.133320:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774678784 00000100:00100000:0.0:1788509391.133343:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774679040 00000100:00100000:0.0:1788509391.133345:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774679040 00000100:00100000:0.0:1788509391.133361:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:0.0:1788509391.133370:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774678912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509391.133434:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774678912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509391.133442:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:0.0:1788509391.133457:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1788509391.133463:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774679168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509391.133487:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774679168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509391.133493:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1788509391.133517:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:0.0:1788509391.133522:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2409:x1875387774678784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509391.133546:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2409:x1875387774678784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509391.133552:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:0.0:1788509391.133572:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:0.0:1788509391.133578:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774679040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509391.133602:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774679040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509391.133608:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00080000:0.0:1788509391.133624:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509391.133627:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509391.134778:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774678656 00000100:00100000:3.0:1788509391.134787:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774678656 00000100:00100000:3.0:1788509391.134837:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 300 00000100:00100000:3.0:1788509391.134846:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774678656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509391.134939:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774678656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 93us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509391.134956:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 300 00000100:00100000:3.0:1788509391.134992:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774679424 00000100:00100000:3.0:1788509391.134996:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774679424 00000100:00100000:3.0:1788509391.135031:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774679296 00000100:00100000:3.0:1788509391.135035:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774679296 00000100:00100000:3.0:1788509391.135055:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1788509391.135062:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774679424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509391.135089:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774679424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509391.135107:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1788509391.135120:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788509391.135126:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774679296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509391.135148:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774679296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509391.135153:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00080000:1.0:1788509391.135514:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509391.135519:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788509391.578887:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e2b56a23-ddae-407e-b137-3c943d18cb4f 00000001:00100000:2.0:1788509391.579119:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2b56a23-ddae-407e-b137-3c943d18cb4f 00000001:00100000:0.0:1788509391.579673:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2b56a23-ddae-407e-b137-3c943d18cb4f 00000001:00100000:3.0:1788509391.585466:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2b56a23-ddae-407e-b137-3c943d18cb4f 00010000:00010000:0.0:1788509391.702610:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788509391.875714:0:12188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788509392.738539:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509393.750986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509394.646231:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788509394.646304:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796768384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509394.646401:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509394.647966:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796768384 00000100:00100000:3.0:1788509394.647978:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796768384 00000100:00100000:3.0:1788509394.648034:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788509394.648045:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796768384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509394.648083:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509394.649246:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796768384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1197us (2851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509394.649259:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788509394.649381:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796768384:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788509394.775813:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509395.158156:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796768512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509395.158226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509395.158304:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796768512 00000100:00100000:0.0:1788509395.158311:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796768512 00000100:00100000:0.0:1788509395.158366:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788509395.158376:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796768512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509395.158410:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509395.158459:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796768512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.158466:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788509395.158502:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788509395.158534:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5d180 x1875387796768512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509395.158553:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796768512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509395.159060:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509395.159074:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796768640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509395.159267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.159567:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796768768:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.159609:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.159657:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796769280:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.159696:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.159717:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796769792:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.159743:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.159766:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788509395.159772:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796768896:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.159811:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.159833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796769408:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.159853:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.159867:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796769920:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.159930:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.159963:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796768768 00000100:00100000:2.0:1788509395.159971:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796768768 00000100:00100000:2.0:1788509395.160022:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788509395.160032:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796768768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160084:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796768768:12345-0@lo:400:kworker.0 Request processed in 53us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509395.160094:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788509395.160152:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796769152:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160175:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.160193:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796769664:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160213:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.160230:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796770176:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160250:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.160269:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788509395.160275:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796769024:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160294:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.160311:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796769536:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160332:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.160341:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796770048:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509395.160376:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796769280 00000100:00100000:2.0:1788509395.160381:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796769280 00000100:00100000:2.0:1788509395.160404:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796769024 00000100:00100000:2.0:1788509395.160407:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796769024 00000100:00100000:2.0:1788509395.160437:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788509395.160449:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796769280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160483:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796769280:12345-0@lo:400:kworker.0 Request processed in 36us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509395.160489:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788509395.160502:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788509395.160507:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796769024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160538:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796769024:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509395.160545:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788509395.160576:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796769024:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160602:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796768768:0@lo:400:kworker.0 00000100:00100000:2.0:1788509395.160611:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796769280:0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.160713:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796768896 00000100:00100000:0.0:1788509395.160717:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796768896 00000100:00100000:0.0:1788509395.160738:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796769408 00000100:00100000:0.0:1788509395.160741:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796769408 00000100:00100000:0.0:1788509395.160770:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796769920 00000100:00100000:0.0:1788509395.160773:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796769920 00000100:00100000:0.0:1788509395.160785:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796769152 00000100:00100000:0.0:1788509395.160788:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796769152 00000100:00100000:0.0:1788509395.160796:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796769536 00000100:00100000:0.0:1788509395.160799:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796769536 00000100:00100000:0.0:1788509395.160809:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796770048 00000100:00100000:0.0:1788509395.160811:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796770048 00000100:00100000:0.0:1788509395.160824:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788509395.160830:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796768896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.160867:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796768896:12345-0@lo:400:kworker.0 Request processed in 38us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.160873:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788509395.160885:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788509395.160891:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796769408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161443:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796769408:12345-0@lo:400:kworker.0 Request processed in 550us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.161449:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788509395.161465:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788509395.161472:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796769920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161499:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796769920:12345-0@lo:400:kworker.0 Request processed in 28us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.161514:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788509395.161527:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788509395.161533:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796769152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161571:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796769152:12345-0@lo:400:kworker.0 Request processed in 38us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.161578:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788509395.161589:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788509395.161595:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796769536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161619:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796769536:12345-0@lo:400:kworker.0 Request processed in 25us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.161625:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788509395.161634:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788509395.161639:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796770048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161664:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796770048:12345-0@lo:400:kworker.0 Request processed in 25us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.161684:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:0.0:1788509395.161732:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3ed80 x1875387796769536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509395.161744:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796769536:0@lo:400:kworker.0 00010000:00080000:0.0:1788509395.161754:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3d500 x1875387796770048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509395.161762:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796770048:0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161771:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796769152:0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161828:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796768896:0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161838:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796769408:0@lo:400:kworker.0 00000100:00100000:0.0:1788509395.161847:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796769920:0@lo:400:kworker.0 00000100:00100000:1.0:1788509395.163005:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796769792 00000100:00100000:1.0:1788509395.163016:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796769792 00000100:00100000:1.0:1788509395.163075:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796769664 00000100:00100000:1.0:1788509395.163078:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796769664 00000100:00100000:1.0:1788509395.163095:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796770176 00000100:00100000:1.0:1788509395.163098:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796770176 00000100:00100000:1.0:1788509395.163126:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788509395.163144:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796769792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509395.163219:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796769792:12345-0@lo:400:kworker.0 Request processed in 85us (3474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509395.163226:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788509395.163255:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788509395.163262:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796769664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509395.163294:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796769664:12345-0@lo:400:kworker.0 Request processed in 33us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509395.163300:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788509395.163312:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788509395.163318:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796770176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509395.163346:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796770176:12345-0@lo:400:kworker.0 Request processed in 29us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509395.163351:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788509395.164416:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509395.164435:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796770304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509395.164488:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509395.164531:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796770304 00000100:00100000:0.0:1788509395.164537:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796770304 00000100:00100000:0.0:1788509395.164569:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788509395.164577:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796770304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509395.164608:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788509395.164663:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796770304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (174us total) trans 0 rc 0/0 00000100:00080000:2.0:1788509395.166212:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788509395.166220:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509395.166223:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509395.166225:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509395.166512:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788509395.166590:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796770304:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1788509395.166642:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3fb80 x1875387796769664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509395.166653:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796769664:0@lo:400:kworker.0 00010000:00080000:0.0:1788509395.166674:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3c380 x1875387796770176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509395.166685:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796770176:0@lo:400:kworker.0 00010000:00080000:0.0:1788509395.166717:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3dc00 x1875387796769792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509395.166745:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796769792:0@lo:400:kworker.0 00000100:00100000:3.0:1788509395.169604:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796768640 00000100:00100000:3.0:1788509395.169984:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796768640 00000100:00100000:3.0:1788509395.170048:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788509395.170058:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796768640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509395.170087:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509395.171065:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796768640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1004us (11794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509395.171076:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788509395.175184:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5e680 x1875387796768640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509395.175212:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796768640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509395.670547:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796770432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509395.670620:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509395.670692:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509395.670699:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796770560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509395.670722:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509395.670754:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796770432 00000100:00100000:0.0:1788509395.670761:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796770432 00000100:00100000:0.0:1788509395.670801:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796770560 00000100:00100000:0.0:1788509395.670805:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796770560 00000100:00100000:0.0:1788509395.670820:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788509395.670828:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796770432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509395.670856:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509395.670934:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796770432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.670942:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788509395.670958:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788509395.670964:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796770560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509395.670974:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509395.671292:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796770560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 327us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509395.671299:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788509395.671407:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87d48000 x1875387796770432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509395.671427:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796770432:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788509395.680505:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5e680 x1875387796770560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509395.680536:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796770560:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788509395.799324:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509396.248315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509396.248375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509396.248403:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509396.248428:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509396.248452:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509396.248717:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509396.248748:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509396.248786:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774679808 00000100:00100000:0.0:1788509396.248798:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774679808 00000100:00100000:0.0:1788509396.248866:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774680064 00000100:00100000:0.0:1788509396.248869:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774680064 00000100:00100000:0.0:1788509396.248885:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774679680 00000100:00100000:0.0:1788509396.248888:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774679680 00000100:00100000:0.0:1788509396.248923:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774679936 00000100:00100000:0.0:1788509396.248927:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774679936 00000100:00100000:0.0:1788509396.248947:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:0.0:1788509396.248958:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774679808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509396.249054:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774679808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 97us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509396.249062:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:0.0:1788509396.249081:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:0.0:1788509396.249088:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774680064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509396.249117:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774680064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509396.249123:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:0.0:1788509396.249151:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:0.0:1788509396.249177:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774679680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509396.249180:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774679552 00000100:00100000:3.0:1788509396.249186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774679552 00000100:00100000:0.0:1788509396.249203:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774679680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509396.249209:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:0.0:1788509396.249220:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788509396.249221:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 302 00000100:00100000:0.0:1788509396.249225:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774679936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509396.249227:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774679552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509396.249247:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774679936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509396.249248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774679552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509396.249254:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788509396.249255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 302 00000100:00100000:0.0:1788509396.249275:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774680320 00000100:00100000:0.0:1788509396.249278:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774680320 00000100:00100000:0.0:1788509396.249311:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774680192 00000100:00100000:0.0:1788509396.249314:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774680192 00000100:00100000:0.0:1788509396.251206:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788509396.251231:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774680320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509396.251354:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774680320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 123us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509396.251362:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788509396.251383:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788509396.251392:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774680192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509396.251417:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774680192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (2668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509396.251424:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00080000:0.0:1788509396.251451:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509396.251475:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509396.251479:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509396.251482:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788509396.829719:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509397.846839:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509398.870384:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509399.767324:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509399.767355:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796770688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509399.767737:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509399.767828:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796770688 00000100:00100000:3.0:1788509399.767838:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796770688 00000100:00100000:3.0:1788509399.767919:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788509399.767929:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796770688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509399.767975:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509399.768043:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796770688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509399.768062:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788509399.768237:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796770688:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788509399.899992:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788509399.960764:0:12504:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788509399.961400:0:12504:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788509400.278252:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796770944:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278348:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796771456:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278460:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278489:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796771968:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278524:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278554:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788509400.278561:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796770816:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278596:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278618:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796771328:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278645:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278663:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796771840:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278687:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278704:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796772352:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278725:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278755:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796771200:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278779:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278797:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796771712:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278834:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278862:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796772224:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278884:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278934:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788509400.278940:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796771072:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.278979:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796771584:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.278997:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.279006:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796772096:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279035:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509400.279059:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796770944 00000100:00100000:2.0:1788509400.279069:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796770944 00000100:00100000:2.0:1788509400.279127:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796771456 00000100:00100000:2.0:1788509400.279130:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796771456 00000100:00100000:2.0:1788509400.279155:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796771968 00000100:00100000:2.0:1788509400.279158:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796771968 00000100:00100000:2.0:1788509400.279170:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796771200 00000100:00100000:2.0:1788509400.279173:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796771200 00000100:00100000:2.0:1788509400.279182:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796771584 00000100:00100000:2.0:1788509400.279185:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796771584 00000100:00100000:2.0:1788509400.279195:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796772096 00000100:00100000:2.0:1788509400.279197:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796772096 00000100:00100000:2.0:1788509400.279211:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788509400.279219:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796770944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279280:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796770944:12345-0@lo:400:kworker.0 Request processed in 61us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279288:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788509400.279313:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788509400.279320:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796771456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279351:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796771456:12345-0@lo:400:kworker.0 Request processed in 32us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279357:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788509400.279367:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788509400.279373:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796771968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279399:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796771968:12345-0@lo:400:kworker.0 Request processed in 27us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279404:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788509400.279424:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788509400.279430:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796771200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279460:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796771200:12345-0@lo:400:kworker.0 Request processed in 31us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279467:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788509400.279477:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788509400.279483:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796771584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279508:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796771584:12345-0@lo:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279514:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788509400.279524:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788509400.279529:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796772096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279553:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796772096:12345-0@lo:400:kworker.0 Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279558:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788509400.279587:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796770816 00000100:00100000:2.0:1788509400.279590:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796770816 00000100:00100000:2.0:1788509400.279614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788509400.279621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796770816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279652:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796770816:12345-0@lo:400:kworker.0 Request processed in 31us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279658:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788509400.279689:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796771328 00000100:00100000:2.0:1788509400.279692:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796771328 00000100:00100000:2.0:1788509400.279717:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796771072 00000100:00100000:2.0:1788509400.279719:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796771072 00000100:00100000:2.0:1788509400.279741:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788509400.279746:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796771328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279780:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796771328:12345-0@lo:400:kworker.0 Request processed in 33us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788509400.279797:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788509400.279803:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796771072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.279846:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796771072:12345-0@lo:400:kworker.0 Request processed in 43us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.279852:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788509400.279877:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796771840 00000100:00100000:2.0:1788509400.279881:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796771840 00000100:00100000:2.0:1788509400.279931:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796772352 00000100:00100000:2.0:1788509400.279934:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796772352 00000100:00100000:2.0:1788509400.279945:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796771712 00000100:00100000:2.0:1788509400.279947:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796771712 00000100:00100000:2.0:1788509400.279960:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796772224 00000100:00100000:2.0:1788509400.279962:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796772224 00000100:00100000:2.0:1788509400.279972:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788509400.279978:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796771840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280008:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796771840:12345-0@lo:400:kworker.0 Request processed in 30us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.280014:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788509400.280024:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788509400.280029:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796772352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280057:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796772352:12345-0@lo:400:kworker.0 Request processed in 28us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.280062:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788509400.280079:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788509400.280085:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796771712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280129:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796771712:12345-0@lo:400:kworker.0 Request processed in 44us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.280135:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788509400.280146:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788509400.280152:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796772224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280180:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796772224:12345-0@lo:400:kworker.0 Request processed in 28us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509400.280185:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788509400.280208:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788509400.280213:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509400.280216:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509400.280217:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509400.280261:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796771072:0@lo:400:kworker.0 00010000:00080000:2.0:1788509400.280277:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3ed80 x1875387796771584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509400.280289:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796771584:0@lo:400:kworker.0 00010000:00080000:2.0:1788509400.280300:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119ed80 x1875387796772096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509400.280308:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796772096:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280323:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796771200:0@lo:400:kworker.0 00010000:00080000:2.0:1788509400.280332:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119d500 x1875387796771712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509400.280353:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796771712:0@lo:400:kworker.0 00010000:00080000:2.0:1788509400.280366:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119dc00 x1875387796772224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509400.280374:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796772224:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280420:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796770816:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796771328:0@lo:400:kworker.0 00010000:00080000:2.0:1788509400.280442:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119c000 x1875387796771840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509400.280450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796771840:0@lo:400:kworker.0 00010000:00080000:2.0:1788509400.280460:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78ad880 x1875387796772352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509400.280467:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796772352:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280478:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796770944:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280489:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796771456:0@lo:400:kworker.0 00000100:00100000:2.0:1788509400.280500:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796771968:0@lo:400:kworker.0 00000100:00100000:1.0:1788509400.280945:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509400.280960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796772480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509400.281023:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509400.281258:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796772480 00000100:00100000:3.0:1788509400.281265:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796772480 00000100:00100000:3.0:1788509400.281318:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788509400.281327:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796772480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509400.281360:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509400.281413:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796772480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509400.281420:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788509400.281466:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5e680 x1875387796772480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509400.281483:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796772480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509400.284175:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796772608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509400.284297:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509400.284375:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796772608 00000100:00100000:0.0:1788509400.284385:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796772608 00000100:00100000:0.0:1788509400.284455:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788509400.284466:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796772608:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509400.284687:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509400.284697:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796772736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509400.284734:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509400.284764:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796772736 00000100:00100000:3.0:1788509400.284769:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796772736 00000100:00100000:3.0:1788509400.284800:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788509400.284825:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796772736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509400.284854:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509400.284923:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796772736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509400.284931:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788509400.284975:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5e680 x1875387796772736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509400.285019:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796772736:0@lo:13:osp-pre-1-0.0 00000004:00000024:0.0:1788509400.287027:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788509400.287154:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796772608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2684us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509400.287165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788509400.287727:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796772608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509400.791025:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796772864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509400.791123:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509400.791862:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796772864 00000100:00100000:1.0:1788509400.791873:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796772864 00000100:00100000:1.0:1788509400.791965:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788509400.791978:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796772864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788509400.792015:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509400.792113:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796772864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509400.792120:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788509400.792396:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5e680 x1875387796772864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509400.792422:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796772864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509400.792940:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796772992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509400.792996:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509400.793264:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796772992 00000100:00100000:0.0:1788509400.793272:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796772992 00000100:00100000:0.0:1788509400.793323:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788509400.793333:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796772992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509400.793354:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509400.793404:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796772992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509400.793411:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788509400.793446:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78bc380 x1875387796772992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509400.793463:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796772992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788509400.920179:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509401.371139:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509401.371188:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509401.371218:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509401.371244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509401.371268:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509401.371288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509401.371314:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509401.371347:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774680704 00000100:00100000:3.0:1788509401.371359:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774680704 00000100:00100000:3.0:1788509401.371422:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774680960 00000100:00100000:3.0:1788509401.371425:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774680960 00000100:00100000:3.0:1788509401.371439:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774680576 00000100:00100000:3.0:1788509401.371442:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774680576 00000100:00100000:3.0:1788509401.371452:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774680832 00000100:00100000:3.0:1788509401.371455:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774680832 00000100:00100000:3.0:1788509401.371472:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:3.0:1788509401.371484:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774680704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509401.371589:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774680704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509401.371606:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:3.0:1788509401.371627:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:3.0:1788509401.371633:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774680960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509401.371660:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774680960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509401.371667:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:3.0:1788509401.371677:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:3.0:1788509401.371682:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774680576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509401.371720:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774680576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509401.371727:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:3.0:1788509401.371737:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:3.0:1788509401.371743:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774680832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509401.371763:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774680832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509401.371769:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:3.0:1788509401.371791:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774681216 00000100:00100000:3.0:1788509401.371794:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774681216 00000100:00100000:3.0:1788509401.371824:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774681088 00000100:00100000:3.0:1788509401.371827:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774681088 00000100:00100000:3.0:1788509401.371849:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:3.0:1788509401.371856:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774681216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509401.371880:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774681216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509401.371892:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:3.0:1788509401.371920:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788509401.371926:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774681088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509401.371950:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774681088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509401.371956:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00080000:3.0:1788509401.371987:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509401.371992:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509401.371995:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509401.371997:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509401.394210:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774680448 00000100:00100000:2.0:1788509401.394234:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774680448 00000100:00100000:2.0:1788509401.394332:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 304 00000100:00100000:2.0:1788509401.394345:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774680448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509401.394500:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774680448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 156us (23373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509401.394509:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 304 00010000:00010000:2.0:1788509401.946681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509402.976796:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788509403.024048:0:12602:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788509403.025750:0:12602:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788509403.991549:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509404.886060:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796773120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509404.886170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509404.886305:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796773120 00000100:00100000:3.0:1788509404.886402:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796773120 00000100:00100000:3.0:1788509404.890320:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788509404.890347:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796773120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509404.890401:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509404.890506:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796773120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509404.890514:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788509404.890583:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796773120:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788509405.014205:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509405.398281:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796773376:0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.398403:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.398469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796773888:0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.398493:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.398523:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796774400:0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.398546:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.398590:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788509405.398596:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796773504:0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.398623:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.398652:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796774016:0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.398677:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.398696:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796774528:0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.398716:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.398757:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796773376 00000100:00100000:0.0:1788509405.398767:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796773376 00000100:00100000:0.0:1788509405.398818:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796773888 00000100:00100000:0.0:1788509405.398821:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796773888 00000100:00100000:0.0:1788509405.398845:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796774400 00000100:00100000:0.0:1788509405.398848:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796774400 00000100:00100000:0.0:1788509405.398866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788509405.398875:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796773376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.398982:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796773376:12345-0@lo:400:kworker.0 Request processed in 94us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509405.398991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788509405.399009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788509405.399014:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796773888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.399042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796773888:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509405.399055:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788509405.399079:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788509405.399086:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796774400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.399115:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796774400:12345-0@lo:400:kworker.0 Request processed in 30us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509405.399120:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788509405.399143:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796773504 00000100:00100000:0.0:1788509405.399147:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796773504 00000100:00100000:0.0:1788509405.399171:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788509405.399177:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796773504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.399210:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796773504:12345-0@lo:400:kworker.0 Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509405.399217:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788509405.399236:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796774016 00000100:00100000:0.0:1788509405.399239:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796774016 00000100:00100000:0.0:1788509405.399265:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796774528 00000100:00100000:0.0:1788509405.399268:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796774528 00000100:00100000:0.0:1788509405.399289:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788509405.399296:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796774016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.399326:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796774016:12345-0@lo:400:kworker.0 Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509405.399338:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788509405.399351:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788509405.399357:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796774528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.399381:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796774528:12345-0@lo:400:kworker.0 Request processed in 25us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509405.399396:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788509405.399417:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796773632:0@lo:400:kworker.0 00000100:00080000:0.0:1788509405.399421:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509405.399425:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509405.399427:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509405.399463:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.399467:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796773504:0@lo:400:kworker.0 00010000:00080000:0.0:1788509405.399481:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119d880 x1875387796774016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509405.399491:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796774016:0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796774144:0@lo:400:kworker.0 00010000:00080000:0.0:1788509405.399501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119ed80 x1875387796774528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509405.399510:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796774528:0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399512:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.399521:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796773376:0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399527:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796774656:0@lo:400:kworker.0 00010000:00080000:0.0:1788509405.399529:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78af800 x1875387796773888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509405.399537:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796773888:0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399545:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788509405.399546:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119d500 x1875387796774400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509405.399554:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796774400:0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399567:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788509405.399574:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796773248:0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399613:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509405.399643:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796773760:0@lo:400:kworker.0 00000100:00100000:2.0:1788509405.399657:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796773632 00000100:00100000:2.0:1788509405.399662:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796773632 00000100:00100000:1.0:1788509405.399666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509405.399680:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796774272:0@lo:400:kworker.0 00000100:00100000:2.0:1788509405.399684:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796773760 00000100:00100000:2.0:1788509405.399686:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796773760 00000100:00100000:1.0:1788509405.399701:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509405.399703:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788509405.399709:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796773632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399728:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796774144 00000100:00100000:1.0:1788509405.399731:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796774144 00000100:00100000:2.0:1788509405.399748:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796773632:12345-0@lo:400:kworker.0 Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509405.399754:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788509405.399754:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796774656 00000100:00100000:1.0:1788509405.399757:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796774656 00000100:00100000:2.0:1788509405.399764:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796774272 00000100:00100000:2.0:1788509405.399767:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796774272 00000100:00100000:1.0:1788509405.399775:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788509405.399779:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788509405.399781:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796774144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509405.399784:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796773760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509405.399810:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796773760:12345-0@lo:400:kworker.0 Request processed in 25us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509405.399810:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796774144:12345-0@lo:400:kworker.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509405.399816:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788509405.399816:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788509405.399826:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788509405.399831:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796774272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399843:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788509405.399849:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796774656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509405.399853:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796774272:12345-0@lo:400:kworker.0 Request processed in 23us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509405.399858:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788509405.399872:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796774656:12345-0@lo:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509405.399878:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788509405.399918:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796773760:0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399929:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796774272:0@lo:400:kworker.0 00000100:00100000:1.0:1788509405.399937:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796773632:0@lo:400:kworker.0 00010000:00080000:1.0:1788509405.399946:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119c000 x1875387796774144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509405.399966:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796774144:0@lo:400:kworker.0 00010000:00080000:1.0:1788509405.399993:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3d500 x1875387796774656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509405.400002:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796774656:0@lo:400:kworker.0 00000100:00100000:3.0:1788509405.400161:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796774784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509405.400199:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509405.400236:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796774784 00000100:00100000:3.0:1788509405.400240:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796774784 00000100:00100000:3.0:1788509405.400266:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788509405.400272:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796774784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509405.400305:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509405.400344:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796774784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509405.400350:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788509405.400750:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c43480 x1875387796774784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509405.400764:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796774784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509405.402515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796773248 00000100:00100000:0.0:1788509405.402526:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796773248 00000100:00100000:0.0:1788509405.402628:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788509405.402640:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796773248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509405.402753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796773248:12345-0@lo:400:kworker.0 Request processed in 116us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509405.402779:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788509405.402864:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796773248:0@lo:400:kworker.0 00000100:00080000:3.0:1788509405.406243:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509405.406257:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509405.406261:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509405.408280:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796775040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509405.408386:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.408445:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509405.408453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796774912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509405.408483:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509405.408590:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796775040 00000100:00100000:3.0:1788509405.408600:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796775040 00000100:00100000:3.0:1788509405.408668:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788509405.408679:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796775040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509405.408709:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509405.408763:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796775040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509405.408771:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788509405.408845:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796774912 00000100:00100000:2.0:1788509405.408850:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796774912 00000100:00100000:2.0:1788509405.408920:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788509405.408938:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796774912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509405.408969:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788509405.409010:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796774912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509405.409017:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788509405.409270:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796774912:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1788509405.409285:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3c380 x1875387796775040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509405.409298:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796775040:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1788509405.716569:0:12699:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509405.716920:0:12699:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788509405.910439:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796775168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509405.910550:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509405.910636:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796775168 00000100:00100000:1.0:1788509405.910645:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796775168 00000100:00100000:1.0:1788509405.910704:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788509405.910713:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796775168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788509405.910747:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509405.910797:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796775168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509405.910805:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788509405.910870:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78bf800 x1875387796775168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509405.910893:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796775168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509405.911173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796775296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509405.911211:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509405.911274:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796775296 00000100:00100000:0.0:1788509405.911280:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796775296 00000100:00100000:0.0:1788509405.911315:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788509405.911322:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796775296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509405.911333:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509405.911368:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796775296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509405.911374:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788509405.911430:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78bd880 x1875387796775296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509405.911444:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796775296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788509406.039625:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509406.484406:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509406.484453:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509406.484495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509406.484532:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509406.484558:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509406.485459:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774681472 00000100:00100000:1.0:1788509406.485475:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774681472 00000100:00100000:1.0:1788509406.485558:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774681728 00000100:00100000:1.0:1788509406.485562:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774681728 00000100:00100000:1.0:1788509406.485583:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774681600 00000100:00100000:1.0:1788509406.485586:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774681600 00000100:00100000:1.0:1788509406.485599:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774681856 00000100:00100000:1.0:1788509406.485602:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774681856 00000100:00100000:1.0:1788509406.485646:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:1.0:1788509406.485656:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774681472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509406.485764:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774681472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 109us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509406.485784:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:1.0:1788509406.485823:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:1.0:1788509406.485831:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774681728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509406.485859:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774681728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509406.485866:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:1.0:1788509406.485879:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:1.0:1788509406.485886:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774681600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509406.485952:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774681600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509406.485959:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:1.0:1788509406.485974:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:1.0:1788509406.485981:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774681856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509406.486006:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774681856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509406.486012:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:0.0:1788509406.486785:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774681344 00000100:00100000:0.0:1788509406.486796:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774681344 00000100:00100000:0.0:1788509406.486852:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 306 00000100:00100000:0.0:1788509406.486861:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774681344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509406.486933:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774681344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (2436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509406.486956:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 306 00000100:00080000:3.0:1788509406.487297:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509406.487313:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509406.488515:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509406.488558:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509406.488640:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774681984 00000100:00100000:1.0:1788509406.488650:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774681984 00000100:00100000:1.0:1788509406.488724:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774682112 00000100:00100000:1.0:1788509406.488727:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774682112 00000100:00100000:1.0:1788509406.488786:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788509406.488799:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2406:x1875387774681984:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1788509406.488835:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd97f 00000100:00080000:1.0:1788509406.488846:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcdb7868000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788509406.488935:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788509406.489136:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+2:2406:x1875387774681984:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 340us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509406.489144:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788509406.489176:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788509406.489184:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2406:x1875387774682112:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1788509406.489197:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd986 00000100:00080000:1.0:1788509406.489203:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcdb7869800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788509406.489226:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788509406.489306:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+2:2406:x1875387774682112:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 124us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509406.489313:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00010000:00010000:1.0:1788509406.489342:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509406.489349:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788509406.490039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509406.490045:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788509407.063461:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509408.086039:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788509408.159158:0:12797:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509408.159517:0:12797:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788509409.110090:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509410.006627:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796775424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509410.006771:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509410.006873:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796775424 00000100:00100000:1.0:1788509410.006881:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796775424 00000100:00100000:1.0:1788509410.006965:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788509410.006976:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796775424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509410.007012:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509410.007082:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796775424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509410.007100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788509410.007465:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796775424:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788509410.150485:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788509410.395561:0:12894:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509410.395793:0:12894:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788509410.526526:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796775552:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.526609:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.526657:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796776064:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.526686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.526707:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796776576:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.526729:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.526753:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788509410.526759:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796775936:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.526781:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.526810:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796776448:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.526837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.526857:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796776960:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.526877:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.526964:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796775680:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.526991:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.527009:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796776192:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.527054:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796776704:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527072:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.527084:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788509410.527088:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796775808:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527109:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.527123:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796776320:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527142:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.527158:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796776832:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527174:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.527207:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796775552 00000100:00100000:2.0:1788509410.527215:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796775552 00000100:00100000:2.0:1788509410.527501:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788509410.527511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796775552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527612:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796775552:12345-0@lo:400:kworker.0 Request processed in 101us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.527620:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788509410.527653:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796776064 00000100:00100000:2.0:1788509410.527665:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796776064 00000100:00100000:2.0:1788509410.527695:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796776576 00000100:00100000:2.0:1788509410.527698:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796776576 00000100:00100000:2.0:1788509410.527710:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796775936 00000100:00100000:2.0:1788509410.527712:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796775936 00000100:00100000:2.0:1788509410.527721:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796775680 00000100:00100000:2.0:1788509410.527724:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796775680 00000100:00100000:2.0:1788509410.527733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796776192 00000100:00100000:2.0:1788509410.527735:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796776192 00000100:00100000:2.0:1788509410.527747:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796776704 00000100:00100000:2.0:1788509410.527749:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796776704 00000100:00100000:2.0:1788509410.527762:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788509410.527768:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796776064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527801:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796776064:12345-0@lo:400:kworker.0 Request processed in 33us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.527808:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788509410.527819:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788509410.527825:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796776576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527851:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796776576:12345-0@lo:400:kworker.0 Request processed in 26us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.527856:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788509410.527868:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788509410.527874:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796775936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527922:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796775936:12345-0@lo:400:kworker.0 Request processed in 49us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.527929:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788509410.527941:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788509410.527947:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796775680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.527991:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796775680:12345-0@lo:400:kworker.0 Request processed in 44us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.527998:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788509410.528009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788509410.528014:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796776192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.528054:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796776192:12345-0@lo:400:kworker.0 Request processed in 39us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.528060:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788509410.528071:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788509410.528076:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796776704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.528102:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796776704:12345-0@lo:400:kworker.0 Request processed in 26us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.528108:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788509410.528133:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796776448 00000100:00100000:2.0:1788509410.528137:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796776448 00000100:00100000:2.0:1788509410.528155:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796776960 00000100:00100000:2.0:1788509410.528158:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796776960 00000100:00100000:2.0:1788509410.528169:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796776320 00000100:00100000:2.0:1788509410.528172:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796776320 00000100:00100000:2.0:1788509410.528183:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796776832 00000100:00100000:2.0:1788509410.528185:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796776832 00000100:00100000:2.0:1788509410.528197:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788509410.528203:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796776448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.528232:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796776448:12345-0@lo:400:kworker.0 Request processed in 29us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.528251:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788509410.528262:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788509410.528273:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796776960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.528299:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796776960:12345-0@lo:400:kworker.0 Request processed in 27us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.528304:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788509410.528313:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788509410.528317:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796776320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.528336:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796776320:12345-0@lo:400:kworker.0 Request processed in 19us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.528341:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788509410.528349:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788509410.528354:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796776832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509410.531243:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509410.531265:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796777088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509410.531333:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509410.531396:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796775808 00000100:00100000:3.0:1788509410.531404:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796775808 00000100:00100000:3.0:1788509410.531451:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788509410.531459:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796775808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509410.531508:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796775808:12345-0@lo:400:kworker.0 Request processed in 49us (4397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509410.531515:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788509410.531535:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509410.531541:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509410.531543:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509410.531557:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509410.531568:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796777088 00000100:00100000:3.0:1788509410.531571:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796777088 00000100:00100000:3.0:1788509410.531598:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788509410.531605:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796777088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509410.531640:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509410.531677:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796777088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509410.531683:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1788509410.531722:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c43100 x1875387796777088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509410.531739:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796777088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509410.531816:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796775936:0@lo:400:kworker.0 00010000:00080000:3.0:1788509410.531829:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87355500 x1875387796776448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509410.531838:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796776448:0@lo:400:kworker.0 00010000:00080000:3.0:1788509410.531848:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787f480 x1875387796776960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509410.531856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796776960:0@lo:400:kworker.0 00000100:00100000:3.0:1788509410.531866:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796775552:0@lo:400:kworker.0 00000100:00100000:3.0:1788509410.531878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796776064:0@lo:400:kworker.0 00000100:00100000:3.0:1788509410.531888:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796776576:0@lo:400:kworker.0 00000100:00100000:3.0:1788509410.531955:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796775808:0@lo:400:kworker.0 00010000:00080000:3.0:1788509410.531967:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356300 x1875387796776320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509410.531975:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796776320:0@lo:400:kworker.0 00000100:00100000:3.0:1788509410.531997:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796775680:0@lo:400:kworker.0 00010000:00080000:3.0:1788509410.532009:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3d500 x1875387796776192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509410.532016:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796776192:0@lo:400:kworker.0 00010000:00080000:3.0:1788509410.532041:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87354a80 x1875387796776704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509410.532049:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796776704:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.532641:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796776832:12345-0@lo:400:kworker.0 Request processed in 4283us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.532651:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788509410.532688:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787e680 x1875387796776832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509410.532698:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796776832:0@lo:400:kworker.0 00000100:00100000:2.0:1788509410.540071:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796777216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509410.540146:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.540193:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509410.540199:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796777344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509410.540229:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509410.540273:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796777344 00000100:00100000:2.0:1788509410.540280:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796777344 00000100:00100000:2.0:1788509410.540323:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788509410.540346:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796777344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509410.540389:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788509410.540435:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796777344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509410.540442:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788509410.540721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796777344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509410.540978:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796777216 00000100:00100000:1.0:1788509410.540983:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796777216 00000100:00100000:1.0:1788509410.541016:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788509410.541024:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796777216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509410.541051:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509410.541097:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796777216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509410.541104:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788509410.541144:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5f480 x1875387796777216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509410.541158:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796777216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509411.030786:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509411.030808:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796777472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509411.030874:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509411.030987:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796777472 00000100:00100000:3.0:1788509411.030996:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796777472 00000100:00100000:3.0:1788509411.031053:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788509411.031064:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796777472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509411.031090:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509411.031145:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796777472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509411.031152:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788509411.031638:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78bf100 x1875387796777472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509411.031656:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796777472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509411.043495:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509411.043517:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796777600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509411.043605:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509411.043665:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796777600 00000100:00100000:3.0:1788509411.043672:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796777600 00000100:00100000:3.0:1788509411.043721:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788509411.043732:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796777600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509411.043753:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509411.043810:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796777600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509411.043828:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1788509411.043957:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c43100 x1875387796777600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509411.043976:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796777600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788509411.161257:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788509411.548546:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2b56a23-ddae-407e-b137-3c943d18cb4f 00000020:00000080:2.0:1788509411.548556:0:8431:0:(genops.c:885:class_export_put()) final put ffff8bcdb786f000/e2b56a23-ddae-407e-b137-3c943d18cb4f 00000020:00000080:1.0:1788509411.548749:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb786f000/e2b56a23-ddae-407e-b137-3c943d18cb4f for lustre-OST0000 00000001:00100000:2.0:1788509411.548778:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2b56a23-ddae-407e-b137-3c943d18cb4f 00000020:00000080:2.0:1788509411.548783:0:9517:0:(genops.c:885:class_export_put()) final put ffff8bcdb786e800/e2b56a23-ddae-407e-b137-3c943d18cb4f 00000020:00000080:1.0:1788509411.548829:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb7868000 for lustre-OST0000 00000020:00000080:1.0:1788509411.548836:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb786e800/e2b56a23-ddae-407e-b137-3c943d18cb4f for lustre-OST0001 00000020:00000080:1.0:1788509411.548858:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb7869800 for lustre-OST0001 00000100:00100000:3.0:1788509411.611055:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509411.611097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509411.611125:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774682240 00000100:00100000:3.0:1788509411.611134:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774682240 00000100:00100000:3.0:1788509411.611181:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 308 00000100:00100000:3.0:1788509411.611190:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774682240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509411.611285:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774682240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509411.611293:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 308 00000100:00100000:3.0:1788509411.611327:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774682368 00000100:00100000:3.0:1788509411.611331:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774682368 00000100:00100000:3.0:1788509411.611630:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1788509411.611637:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774682368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509411.611669:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774682368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509411.611675:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00080000:3.0:1788509411.611788:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509411.619806:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509411.619847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509411.619875:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774682496 00000100:00100000:2.0:1788509411.619884:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774682496 00000100:00100000:2.0:1788509411.619962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774682624 00000100:00100000:2.0:1788509411.619965:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774682624 00000100:00100000:2.0:1788509411.619992:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:2.0:1788509411.620001:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774682496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509411.620081:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774682496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509411.620089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:2.0:1788509411.620106:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:2.0:1788509411.620113:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774682624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509411.620138:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774682624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509411.620155:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00080000:2.0:1788509411.620175:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509411.620179:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509411.621487:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509411.621979:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774682752 00000100:00100000:2.0:1788509411.621988:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774682752 00000100:00100000:2.0:1788509411.622061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:2.0:1788509411.622070:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774682752:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509411.622127:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774682752:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 58us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509411.622134:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00080000:1.0:1788509411.622627:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788509412.182639:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509413.206188:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509414.231240:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788509415.101863:0:13038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788509415.130356:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509415.130387:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796777728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509415.130475:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.130556:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796777728 00000100:00100000:0.0:1788509415.130566:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796777728 00000100:00100000:0.0:1788509415.130626:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788509415.130637:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796777728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788509415.130682:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788509415.130737:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796777728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.130744:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788509415.130802:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796777728:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509415.254026:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509415.638415:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796777984:0@lo:400:kworker.0 00000100:00100000:2.0:1788509415.638505:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509415.638585:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796778496:0@lo:400:kworker.0 00000100:00100000:2.0:1788509415.638608:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509415.638632:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796779008:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.638742:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796777856:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.638783:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.638805:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796778368:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.638825:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.638839:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796778880:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.638876:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.638945:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788509415.638952:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796778240:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.638973:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.638983:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796778752:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639016:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.639031:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796779264:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639049:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.639124:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796777984 00000100:00100000:0.0:1788509415.639132:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796777984 00000100:00100000:0.0:1788509415.639179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796778496 00000100:00100000:0.0:1788509415.639181:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796778496 00000100:00100000:0.0:1788509415.639205:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796778368 00000100:00100000:0.0:1788509415.639208:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796778368 00000100:00100000:0.0:1788509415.639218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796778880 00000100:00100000:0.0:1788509415.639220:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796778880 00000100:00100000:0.0:1788509415.639230:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796778240 00000100:00100000:0.0:1788509415.639232:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796778240 00000100:00100000:0.0:1788509415.639246:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788509415.639255:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796777984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639308:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796777984:12345-0@lo:400:kworker.0 Request processed in 53us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.639315:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788509415.639333:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788509415.639339:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796778496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639365:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796778496:12345-0@lo:400:kworker.0 Request processed in 27us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.639371:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788509415.639391:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788509415.639397:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796778368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639428:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796778368:12345-0@lo:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.639434:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788509415.639444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788509415.639450:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796778880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639471:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796778880:12345-0@lo:400:kworker.0 Request processed in 22us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.639477:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788509415.639486:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788509415.639491:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796778240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639510:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796778240:12345-0@lo:400:kworker.0 Request processed in 20us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.639516:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788509415.639535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796778112:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639562:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.639581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796778624:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639602:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.639616:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796779136:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.639633:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509415.639797:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796777856 00000100:00100000:3.0:1788509415.639802:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796777856 00000100:00100000:3.0:1788509415.639833:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788509415.639840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3645:x1875387796777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509415.639875:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3645:x1875387796777856:12345-0@lo:400:kworker.0 Request processed in 36us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509415.639882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788509415.639934:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796778752 00000100:00100000:3.0:1788509415.639937:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796778752 00000100:00100000:3.0:1788509415.639963:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796779264 00000100:00100000:3.0:1788509415.639965:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796779264 00000100:00100000:3.0:1788509415.639977:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796778624 00000100:00100000:3.0:1788509415.639979:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796778624 00000100:00100000:3.0:1788509415.640004:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788509415.640011:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796778752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509415.640041:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796778752:12345-0@lo:400:kworker.0 Request processed in 31us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509415.640047:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788509415.640057:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788509415.640063:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796779264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509415.640084:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796779264:12345-0@lo:400:kworker.0 Request processed in 22us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509415.640090:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788509415.640098:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788509415.640104:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796778624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509415.640125:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796778624:12345-0@lo:400:kworker.0 Request processed in 22us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509415.640130:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788509415.640184:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509415.640193:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796779392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509415.640219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509415.640245:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796779392 00000100:00100000:3.0:1788509415.640248:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796779392 00000100:00100000:3.0:1788509415.640270:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788509415.640276:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796779392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509415.640308:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509415.640344:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796779392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509415.640351:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788509415.640390:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c42680 x1875387796779392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509415.640412:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796779392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509415.640472:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796778112 00000100:00100000:3.0:1788509415.640475:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796778112 00000100:00100000:3.0:1788509415.640501:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788509415.640507:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796778112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509415.640537:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796778112:12345-0@lo:400:kworker.0 Request processed in 30us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509415.640544:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1788509415.640584:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509415.640589:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509415.640591:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509415.640593:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509415.644146:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796778112:0@lo:400:kworker.0 00010000:00080000:0.0:1788509415.644169:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdbbfda680 x1875387796778624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509415.644208:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796778624:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.644231:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509415.644243:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796779520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509415.644303:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509415.644340:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796779520 00000100:00100000:0.0:1788509415.644347:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796779520 00000100:00100000:0.0:1788509415.644394:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788509415.644403:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796779520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509415.644445:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788509415.644487:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796779520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.644494:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788509415.644530:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796779520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509415.644691:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509415.644722:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796777984:0@lo:400:kworker.0 00010000:00080000:2.0:1788509415.644735:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdbbfd8000 x1875387796778496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509415.644744:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796778496:0@lo:400:kworker.0 00000100:00100000:3.0:1788509415.646283:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796779136 00000100:00100000:3.0:1788509415.646293:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796779136 00000100:00100000:3.0:1788509415.646368:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788509415.646378:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796779136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509415.646463:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796779136:12345-0@lo:400:kworker.0 Request processed in 87us (6828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509415.646470:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788509415.646493:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509415.647554:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796779008 00000100:00100000:0.0:1788509415.647566:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796779008 00000100:00100000:0.0:1788509415.648765:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788509415.648787:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796779008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.648884:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796779008:12345-0@lo:400:kworker.0 Request processed in 107us (4191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.648891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788509415.650293:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788509415.650501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdbbfdaa00 x1875387796779008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509415.650521:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796779008:0@lo:400:kworker.0 00000100:00100000:2.0:1788509415.650577:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788509415.650591:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796779648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509415.650671:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788509415.650736:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdbbfdb480 x1875387796779136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509415.650747:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796779136:0@lo:400:kworker.0 00000100:00100000:1.0:1788509415.651198:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796778240:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.652490:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796779648 00000100:00100000:0.0:1788509415.652504:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796779648 00000100:00100000:0.0:1788509415.652775:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788509415.652787:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796779648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788509415.652823:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509415.652976:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796779648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 190us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509415.652983:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788509415.653057:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdbbfd9c00 x1875387796778752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509415.653072:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796778752:0@lo:400:kworker.0 00010000:00080000:0.0:1788509415.653087:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913e4380 x1875387796779264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509415.653095:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796779264:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.653106:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796777856:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.653118:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796778368:0@lo:400:kworker.0 00000100:00100000:0.0:1788509415.653130:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796778880:0@lo:400:kworker.0 00010000:00080000:2.0:1788509415.654942:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c42680 x1875387796779648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509415.654972:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796779648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509416.150085:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509416.150116:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796779776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509416.150207:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509416.150286:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796779776 00000100:00100000:0.0:1788509416.150296:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796779776 00000100:00100000:0.0:1788509416.150356:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788509416.150367:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796779776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509416.150402:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509416.150450:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796779776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509416.150458:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788509416.150523:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78bd880 x1875387796779776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509416.150556:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796779776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509416.153967:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509416.154006:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796779904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509416.154094:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509416.154162:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796779904 00000100:00100000:0.0:1788509416.154172:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796779904 00000100:00100000:0.0:1788509416.154229:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788509416.154239:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796779904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509416.154267:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509416.154318:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796779904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509416.154326:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788509416.154387:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78bd880 x1875387796779904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509416.154409:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796779904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788509416.281249:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509416.747178:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509416.747232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509416.747260:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509416.747280:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509416.747304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509416.747315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774682880 00000100:00100000:0.0:1788509416.747325:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774683008 00000100:00100000:3.0:1788509416.747335:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774682880 00000100:00100000:0.0:1788509416.747335:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774683008 00000100:00100000:0.0:1788509416.747386:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774683264 00000100:00100000:0.0:1788509416.747389:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774683264 00000100:00100000:3.0:1788509416.747391:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 310 00000100:00100000:0.0:1788509416.747402:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774683136 00000100:00100000:3.0:1788509416.747403:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2407:x1875387774682880:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509416.747404:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774683136 00000100:00100000:0.0:1788509416.747425:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774683392 00000100:00100000:0.0:1788509416.747428:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774683392 00000100:00100000:0.0:1788509416.747442:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:0.0:1788509416.747448:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774683008:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509416.747489:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2407:x1875387774682880:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509416.747489:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774683008:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509416.747496:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:3.0:1788509416.747505:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 310 00000100:00100000:0.0:1788509416.747514:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:0.0:1788509416.747519:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774683264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509416.747541:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774683264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509416.747547:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:0.0:1788509416.747557:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:0.0:1788509416.747562:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774683136:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509416.747584:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774683136:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509416.747589:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:0.0:1788509416.747598:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:0.0:1788509416.747603:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774683392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509416.747622:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774683392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509416.747628:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00080000:0.0:1788509416.747652:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509416.747656:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788509417.302549:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509418.326154:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788509418.887853:0:13186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe71904020 20000000:00000080:2.0:1788509418.887871:0:13186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bcdb5a06400 uarg=0000000000000000 20000000:01000000:2.0:1788509418.888322:0:13186:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788509418.888329:0:13186:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788509418.888334:0:13186:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788509418.888724:0:13187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788509418.888883:0:13186:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788509418.896137:0:13186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788509418.896167:0:13186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896187:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896196:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd924 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896203:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd932 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896230:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd940 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896238:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd94e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896245:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896252:0:13186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896289:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896304:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 12 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509418.896377:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780032:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509418.896523:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd94e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896531:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd94e expref: 23 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509418.896540:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780160:0@lo:104: 00000100:00100000:2.0:1788509418.896578:0:13186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509418.896614:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd940 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896641:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd940 expref: 23 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509418.896650:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780288:0@lo:104: 00000100:00100000:2.0:1788509418.896675:0:13186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509418.896742:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd932 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.896750:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd932 expref: 23 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509418.896757:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780416:0@lo:104: 00000100:00100000:2.0:1788509418.896777:0:13186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509418.897715:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796780160 00000100:00100000:1.0:1788509418.897724:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796780160 00000100:00100000:1.0:1788509418.897766:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796780288 00000100:00100000:1.0:1788509418.897769:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796780288 00000100:00100000:1.0:1788509418.897785:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796780416 00000100:00100000:1.0:1788509418.897788:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796780416 00000100:00100000:1.0:1788509418.897802:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788509418.897811:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:13186:x1875387796780160:12345-0@lo:104: 00010000:00010000:1.0:1788509418.897825:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.897911:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509418.897917:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:13186:x1875387796780160:12345-0@lo:104: Request processed in 107us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509418.897924:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788509418.897952:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788509418.897959:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:13186:x1875387796780288:12345-0@lo:104: 00010000:00010000:1.0:1788509418.897966:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898013:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788509418.898018:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:13186:x1875387796780288:12345-0@lo:104: Request processed in 61us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509418.898024:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788509418.898038:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788509418.898055:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:13186:x1875387796780416:12345-0@lo:104: 00010000:00010000:1.0:1788509418.898063:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898090:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788509418.898094:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:13186:x1875387796780416:12345-0@lo:104: Request processed in 41us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509418.898099:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788509418.898118:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788509418.898123:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898129:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509418.898133:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898142:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509418.898148:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509418.898153:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509418.898182:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898188:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509418.898207:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898223:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226000/0xe5156b86310dd94e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd955 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898235:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509418.898238:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898243:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509418.898246:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898252:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509418.898257:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509418.898263:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509418.898274:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898279:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509418.898285:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898291:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590ae00/0xe5156b86310dd940 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd947 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.898298:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509418.898566:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd924 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.898579:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd924 expref: 23 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509418.898590:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780800:0@lo:104: 00000100:00100000:2.0:1788509418.898635:0:13186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509418.898669:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.898678:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 12 pid: 6515 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509418.898688:0:13186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780928:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509418.898739:0:13186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87704d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509418.898764:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780160:0@lo:104: 00000100:00100000:2.0:1788509418.898774:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780288:0@lo:104: 00000100:00100000:2.0:1788509418.898781:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780416:0@lo:104: 00010000:00010000:1.0:1788509418.899122:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.899131:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590aa00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509418.899135:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.899143:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509418.899150:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509418.899155:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509418.899174:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.899180:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509418.899212:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.899219:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590aa00/0xe5156b86310dd932 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd939 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.899229:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509418.899231:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509418.899232:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509418.899240:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509418.899252:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796780544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509418.899283:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509418.899373:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509418.899388:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796780672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509418.899413:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509418.899441:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509418.899449:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796781056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509418.899486:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509418.899516:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796780544 00000100:00100000:1.0:1788509418.899521:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796780544 00010000:00010000:1.0:1788509418.899546:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd94e expref: 24 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509418.899570:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796780672 00000100:00100000:1.0:1788509418.899574:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796780672 00010000:00010000:1.0:1788509418.899586:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd940 expref: 25 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509418.899597:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796781056 00000100:00100000:1.0:1788509418.899599:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796781056 00010000:00010000:1.0:1788509418.899610:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd932 expref: 26 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509418.899962:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796780800 00000100:00100000:3.0:1788509418.899968:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796780800 00000100:00100000:3.0:1788509418.900014:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788509418.900024:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+26:3646:x1875387796780544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509418.900037:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509418.900043:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd94e expref: 26 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.900132:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd94e expref: 26 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.900148:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590a800/0xe5156b86310dd955 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd94e expref: 26 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.900162:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509418.900205:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+25:3646:x1875387796780544:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509418.900212:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788509418.900242:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788509418.900248:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796780672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509418.900267:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509418.900273:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd940 expref: 24 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.900281:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd940 expref: 24 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.900292:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dd947 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd940 expref: 24 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.900302:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509418.900402:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788509418.900413:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:3645:x1875387796781056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509418.900421:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509418.900426:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd932 expref: 23 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.900434:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd932 expref: 23 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.900444:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dd939 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd932 expref: 23 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.900460:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509418.900494:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:3645:x1875387796781056:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509418.900500:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788509418.900547:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796780544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509418.900573:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796781056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509418.900662:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3646:x1875387796780672:12345-0@lo:103:ldlm_bl.0 Request processed in 414us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509418.900669:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788509418.901076:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509418.901112:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774683520 00000100:00100000:3.0:1788509418.901116:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774683520 00010000:00010000:3.0:1788509418.901137:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 13 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509418.901161:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788509418.901169:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774683520:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509418.901178:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509418.901183:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 13 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.901194:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 13 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.901219:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509418.901261:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774683520:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 93us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509418.901269:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:2.0:1788509418.901473:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd96a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fd1 expref: 12 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509418.901486:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780032:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509418.901570:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796780672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788509418.902032:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788509418.902039:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:13186:x1875387796780800:12345-0@lo:104: 00010000:00010000:2.0:1788509418.902052:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509418.902108:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788509418.902114:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:13186:x1875387796780800:12345-0@lo:104: Request processed in 76us (3480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509418.902121:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788509418.902153:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780800:0@lo:104: 00010000:00010000:1.0:1788509418.903531:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509418.903540:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.903549:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509418.903554:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.903563:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509418.903571:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509418.903577:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509418.903632:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.903639:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509418.903673:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.903680:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b000/0xe5156b86310dd924 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd92b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.903698:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509418.903700:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509418.903702:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509418.903708:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509418.903724:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796781184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509418.903772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509418.903821:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796781184 00000100:00100000:1.0:1788509418.903828:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796781184 00010000:00010000:1.0:1788509418.903849:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd924 expref: 21 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509418.903870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788509418.903883:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3644:x1875387796781184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509418.903895:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509418.903916:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd924 expref: 21 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.903927:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd924 expref: 21 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.903940:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227800/0xe5156b86310dd92b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd924 expref: 21 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509418.903951:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509418.904000:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:3644:x1875387796781184:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509418.904007:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788509418.904051:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796781184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788509418.905768:0:13186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1875387796780928:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509418.905802:0:13186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509418.908296:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509418.908421:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774683648 00000100:00100000:3.0:1788509418.908431:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774683648 00010000:00010000:3.0:1788509418.908466:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 12 pid: 6515 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509418.908598:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1788509418.908608:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:2408:x1875387774683648:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509418.908633:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509418.908640:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 12 pid: 6515 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908653:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 12 pid: 6515 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908671:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd91d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f92 expref: 12 pid: 6515 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908687:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908694:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908709:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908726:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908733:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908738:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908743:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509418.908748:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908757:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908781:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509418.908792:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509418.908841:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:2408:x1875387774683648:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 234us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509418.908849:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00010000:00010000:0.0:1788509418.908940:0:13186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509418.908949:0:13186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509418.908955:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310dd98d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509419.350177:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788509419.990162:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509419.990169:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdb59c5000 from 7 10000000:01000000:0.0:1788509419.990173:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509419.990216:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509419.990228:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509419.990238:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509419.990263:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509419.991171:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509419.991218:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509419.991252:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796781312 00000100:00100000:3.0:1788509419.991259:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796781312 00000100:00100000:3.0:1788509419.991334:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788509419.991343:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796781312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509419.991358:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509419.991372:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd994 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509419.991406:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd994 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509419.991415:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd994 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509419.991421:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030000, rc 0) 00000100:00100000:3.0:1788509419.991458:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796781312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509419.991465:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788509419.991491:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509419.991505:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509419.991514:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509419.991643:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509419.991672:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509419.991691:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509419.991737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796781440 00000100:00100000:3.0:1788509419.991741:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796781440 00000100:00100000:3.0:1788509419.991773:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788509419.991780:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796781440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509419.992082:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796781440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509419.992090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788509419.992144:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509419.992170:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509419.992202:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509419.992245:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788509419.992271:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796781568 00000100:00100000:2.0:1788509419.992274:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796781568 00000100:00100000:0.0:1788509419.993394:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788509419.993409:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796781568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509419.993540:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796781568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509419.993548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788509419.993612:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788509419.994838:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788509419.994982:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788509419.995005:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788509419.995015:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509419.995027:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509419.995038:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788509419.995040:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd913e8000 from 7 10000000:01000000:1.0:1788509419.995043:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788509419.995074:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509419.995083:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509419.995093:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509419.995112:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788509419.995160:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509419.995192:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1788509419.995258:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796781696 00000100:00100000:3.0:1788509419.995265:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796781696 00000100:00100000:3.0:1788509419.995315:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788509419.995323:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796781696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509419.995333:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509419.995345:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd9a2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509419.995369:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509419.995388:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509419.995398:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030800, rc 0) 00000100:00100000:3.0:1788509419.995452:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796781696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509419.995460:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788509419.996275:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509419.996295:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509419.996315:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509419.996379:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509419.996414:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509419.996548:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1788509419.997424:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796781824 00000100:00100000:2.0:1788509419.997432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796781824 00000100:00100000:2.0:1788509419.997609:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788509419.997619:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796781824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509419.999431:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796781824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1806us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509419.999444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788509419.999612:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509419.999668:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509419.999725:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509419.999755:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509419.999986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796781952 00000100:00100000:3.0:1788509419.999994:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796781952 00000100:00100000:3.0:1788509420.000031:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788509420.000039:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796781952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509420.000153:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796781952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.000161:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788509420.001026:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796781952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788509420.006708:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788509420.006939:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788509420.006979:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788509420.006991:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509420.007004:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509420.007015:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788509420.007018:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdbbf0f800 from 7 10000000:01000000:3.0:1788509420.007021:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788509420.007057:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509420.007078:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509420.007089:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509420.007119:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788509420.007179:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509420.007221:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509420.007481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796782080 00000100:00100000:2.0:1788509420.007490:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796782080 00000100:00100000:2.0:1788509420.007601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788509420.007614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796782080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509420.007628:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509420.007643:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd9b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.007667:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.007679:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.007689:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227e00, rc 0) 00000100:00100000:2.0:1788509420.007751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796782080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509420.007759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788509420.007952:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509420.007984:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509420.007996:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509420.008061:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509420.008096:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.008139:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509420.008478:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796782208 00000100:00100000:3.0:1788509420.008485:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796782208 00000100:00100000:3.0:1788509420.008556:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788509420.008565:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796782208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509420.008685:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796782208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.008692:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788509420.008752:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509420.008781:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509420.009084:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.009106:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509420.009160:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796782336 00000100:00100000:3.0:1788509420.009164:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796782336 00000100:00100000:3.0:1788509420.009225:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788509420.009234:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796782336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509420.009316:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796782336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.009322:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788509420.009377:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788509420.010100:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788509420.010150:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788509420.010162:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788509420.010170:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509420.010178:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509420.010186:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788509420.010188:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd82e88800 from 7 10000000:01000000:1.0:1788509420.010190:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788509420.010212:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509420.010217:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509420.010223:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509420.010236:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788509420.010274:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.011284:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509420.011543:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796782464 00000100:00100000:2.0:1788509420.011553:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796782464 00000100:00100000:2.0:1788509420.011604:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788509420.011621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796782464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509420.011635:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509420.011650:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dd9be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.011674:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dd9be expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.011684:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd9be expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.011692:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226c00, rc 0) 00000100:00100000:2.0:1788509420.011745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796782464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509420.011752:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788509420.012140:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509420.012158:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509420.012175:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509420.012266:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509420.012300:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.012333:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509420.012654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796782592 00000100:00100000:2.0:1788509420.012660:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796782592 00000100:00100000:2.0:1788509420.012685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788509420.012693:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796782592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509420.012805:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796782592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509420.012813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788509420.012889:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509420.012949:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509420.013003:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.013028:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509420.013077:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796782720 00000100:00100000:2.0:1788509420.013081:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796782720 00000100:00100000:2.0:1788509420.013101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788509420.013107:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796782720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788509420.013182:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796782720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509420.013197:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788509420.013258:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796782720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788509420.014248:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788509420.014397:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788509420.014419:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788509420.014428:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.014438:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509420.181656:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509420.181722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774683776 00000100:00100000:2.0:1788509420.181733:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774683776 00000100:00100000:2.0:1788509420.181782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 323 00000100:00100000:2.0:1788509420.181791:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:6182:x1875387774683776:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509420.181806:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509420.181822:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647553002 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.181846:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.181857:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509420.181865:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227000, rc 0) 00000100:00100000:2.0:1788509420.181944:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774683776:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 153us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509420.181951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 323 00000100:00100000:2.0:1788509420.192696:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509420.192795:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774683904 00000100:00100000:3.0:1788509420.192805:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774683904 00000100:00100000:3.0:1788509420.192926:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 324 00000100:00100000:3.0:1788509420.192938:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774683904:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509420.193115:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774683904:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 179us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.193123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 324 00000100:00100000:0.0:1788509420.212555:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509420.214420:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774684032 00000100:00100000:3.0:1788509420.214435:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774684032 00000100:00100000:3.0:1788509420.214493:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 325 00000100:00100000:3.0:1788509420.214503:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774684032:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509420.214659:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774684032:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 157us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.214667:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 325 00000100:00100000:0.0:1788509420.221074:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509420.222483:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774684160 00000100:00100000:1.0:1788509420.222496:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774684160 00000100:00100000:1.0:1788509420.222556:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 326 00000100:00100000:1.0:1788509420.222567:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774684160:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509420.222582:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509420.222600:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647553009 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509420.222628:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509420.222639:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509420.222648:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9c00, rc 0) 00000100:00100000:1.0:1788509420.222708:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774684160:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 143us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509420.222723:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 326 00000100:00100000:2.0:1788509420.234355:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509420.234657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774684288 00000100:00100000:0.0:1788509420.234667:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774684288 00000100:00100000:0.0:1788509420.234725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 327 00000100:00100000:0.0:1788509420.234735:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774684288:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509420.234932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774684288:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 198us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509420.234940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 327 00000100:00100000:3.0:1788509420.243159:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509420.243318:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774684416 00000100:00100000:0.0:1788509420.243327:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774684416 00000100:00100000:0.0:1788509420.243379:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 328 00000100:00100000:0.0:1788509420.243389:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774684416:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509420.243534:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774684416:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 145us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509420.243542:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 328 00000100:00100000:2.0:1788509420.246321:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796782848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509420.246388:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509420.246926:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796782848 00000100:00100000:0.0:1788509420.246934:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796782848 00000100:00100000:0.0:1788509420.247004:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788509420.247013:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796782848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788509420.247047:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788509420.247109:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796782848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509420.247116:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788509420.247333:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796782848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788509420.376642:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509420.758346:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796783360:0@lo:400:kworker.0 00000100:00100000:1.0:1788509420.758541:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796783104:0@lo:400:kworker.0 00000100:00100000:1.0:1788509420.758578:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.758629:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796783616:0@lo:400:kworker.0 00000100:00100000:1.0:1788509420.758666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.758690:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796784128:0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.758695:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796782976:0@lo:400:kworker.0 00000100:00100000:1.0:1788509420.758730:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509420.758737:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.758766:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788509420.758770:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796783488:0@lo:400:kworker.0 00000100:00100000:1.0:1788509420.758785:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdbbfd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796783232:0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.758796:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509420.758818:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796784000:0@lo:400:kworker.0 00000100:00100000:1.0:1788509420.758824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.758853:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796783744:0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.758855:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509420.758885:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796784512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509420.758885:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.758930:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796784256:0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.758942:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.758980:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509420.758991:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788509420.759000:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796784384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509420.759025:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509420.759075:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796783104 00000100:00100000:3.0:1788509420.759084:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796783104 00000100:00100000:3.0:1788509420.759129:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796784384 00000100:00100000:3.0:1788509420.759132:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796784384 00000100:00100000:3.0:1788509420.759146:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788509420.759154:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796783104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.759209:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796783104:12345-0@lo:400:kworker.0 Request processed in 54us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.759216:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788509420.759233:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788509420.759240:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796784384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509420.759266:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509420.759306:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796784384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.759312:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788509420.759352:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796783616 00000100:00100000:3.0:1788509420.759356:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796783616 00000100:00100000:1.0:1788509420.759377:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796783104:0@lo:400:kworker.0 00000100:00100000:0.0:1788509420.759387:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509420.759388:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796784128 00000100:00100000:3.0:1788509420.759394:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796784128 00000100:00100000:1.0:1788509420.759404:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796784640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509420.759409:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796783744 00000100:00100000:3.0:1788509420.759412:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796783744 00000100:00100000:3.0:1788509420.759423:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796784256 00000100:00100000:3.0:1788509420.759425:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796784256 00000100:00100000:3.0:1788509420.759437:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788509420.759443:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796783616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.759474:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796783616:12345-0@lo:400:kworker.0 Request processed in 31us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.759481:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788509420.759491:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788509420.759505:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796784128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.759534:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796784128:12345-0@lo:400:kworker.0 Request processed in 31us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.759540:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788509420.759550:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788509420.759557:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796783744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.759582:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796783744:12345-0@lo:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.759588:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788509420.759598:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788509420.759606:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796784256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509420.759631:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509420.759646:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796784256:12345-0@lo:400:kworker.0 Request processed in 40us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.759652:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788509420.759674:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796782976 00000100:00100000:3.0:1788509420.759677:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796782976 00000100:00100000:3.0:1788509420.759694:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796783488 00000100:00100000:3.0:1788509420.759697:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796783488 00000100:00100000:3.0:1788509420.759709:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796783232 00000100:00100000:3.0:1788509420.759712:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796783232 00000100:00100000:3.0:1788509420.759720:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796784000 00000100:00100000:3.0:1788509420.759723:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796784000 00000100:00100000:3.0:1788509420.759733:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796783360 00000100:00100000:3.0:1788509420.759736:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796783360 00000100:00100000:3.0:1788509420.759749:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788509420.759754:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796782976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509420.759854:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796783872:0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.760137:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796782976:12345-0@lo:400:kworker.0 Request processed in 381us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.760154:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788509420.760168:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788509420.760174:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796783488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.760205:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796783488:12345-0@lo:400:kworker.0 Request processed in 31us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.760211:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788509420.760221:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788509420.760227:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796783232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.760254:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796783232:12345-0@lo:400:kworker.0 Request processed in 28us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.760260:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788509420.760270:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788509420.760276:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796784000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509420.760299:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509420.760327:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796783232:0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.760329:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796784000:12345-0@lo:400:kworker.0 Request processed in 43us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.760340:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00010000:00080000:1.0:1788509420.760352:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119df80 x1875387796783744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509420.760355:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796783872 00000100:00100000:3.0:1788509420.760361:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788509420.760362:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796783872 00000100:00100000:3.0:1788509420.760374:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796783360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509420.760374:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796783744:0@lo:400:kworker.0 00000100:00100000:0.0:1788509420.760396:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00010000:00080000:1.0:1788509420.760398:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119fb80 x1875387796784256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509420.760428:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796783360:12345-0@lo:400:kworker.0 Request processed in 58us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509420.760434:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788509420.760465:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796784512 00000100:00100000:3.0:1788509420.760470:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796784512 00000100:00100000:3.0:1788509420.760491:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796784640 00000100:00100000:3.0:1788509420.760494:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796784640 00000100:00100000:0.0:1788509420.760518:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796783872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.760521:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788509420.760533:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796784512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509420.760557:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509420.760564:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796783872:12345-0@lo:400:kworker.0 Request processed in 152us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509420.760572:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788509420.760599:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796784512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509420.760599:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788509420.760612:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796784640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509420.760613:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00002000:00000024:0.0:1788509420.760628:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788509420.760649:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509420.760655:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509420.760658:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509420.760663:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509420.760663:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796784640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509420.760673:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788509420.760698:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796784384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509420.760714:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796783360:0@lo:400:kworker.0 00000100:00100000:3.0:1788509420.760717:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdbbfd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796782976:0@lo:400:kworker.0 00000100:00100000:0.0:1788509420.760735:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796783872:0@lo:400:kworker.0 00010000:00080000:3.0:1788509420.760740:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78bd880 x1875387796783488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509420.760752:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796783488:0@lo:400:kworker.0 00010000:00080000:3.0:1788509420.760765:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119f100 x1875387796784000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509420.760773:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796784000:0@lo:400:kworker.0 00010000:00080000:3.0:1788509420.760784:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c41180 x1875387796784512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509420.760797:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796784512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509420.760935:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796784256:0@lo:400:kworker.0 00010000:00080000:1.0:1788509420.761082:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119e680 x1875387796783616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509420.761092:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796783616:0@lo:400:kworker.0 00010000:00080000:1.0:1788509420.761102:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119e300 x1875387796784128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509420.761109:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796784128:0@lo:400:kworker.0 00010000:00080000:1.0:1788509420.761133:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787c380 x1875387796784640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509420.761144:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796784640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509421.270285:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796784768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509421.270362:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509421.270432:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796784768 00000100:00100000:0.0:1788509421.270439:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796784768 00000100:00100000:0.0:1788509421.270486:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788509421.270493:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796784768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509421.270523:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509421.270569:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796784768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509421.270577:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788509421.270626:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119f800 x1875387796784768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509421.270645:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796784768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509421.272945:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796784896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788509421.273023:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509421.273096:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796784896 00000100:00100000:1.0:1788509421.273104:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796784896 00000100:00100000:1.0:1788509421.273585:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788509421.273601:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796784896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788509421.273625:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509421.273680:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796784896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509421.273688:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788509421.273746:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7898e00 x1875387796784896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509421.273782:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796784896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788509421.398243:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509421.848100:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509421.848137:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509421.848160:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509421.848186:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509421.848214:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509421.848247:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774684672 00000100:00100000:2.0:1788509421.848248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774684544 00000100:00100000:2.0:1788509421.848259:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774684544 00000100:00100000:3.0:1788509421.848264:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774684672 00000100:00100000:2.0:1788509421.848317:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 329 00000100:00100000:2.0:1788509421.848335:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774684544:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509421.848355:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774684928 00000100:00100000:3.0:1788509421.848361:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774684928 00000100:00100000:2.0:1788509421.848400:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774684544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509421.848406:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774684800 00000100:00100000:2.0:1788509421.848413:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 329 00000100:00100000:3.0:1788509421.848415:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774684800 00000100:00100000:3.0:1788509421.848440:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774685056 00000100:00100000:3.0:1788509421.848444:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774685056 00000100:00100000:2.0:1788509421.848475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:3.0:1788509421.848489:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:2.0:1788509421.848490:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774684672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509421.848512:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774684928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509421.848529:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774684672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509421.848537:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:2.0:1788509421.848557:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:2.0:1788509421.848565:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774684800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509421.848586:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774684928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509421.848597:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:2.0:1788509421.848605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774684800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509421.848626:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:2.0:1788509421.848637:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:3.0:1788509421.848644:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774685056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509421.848686:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774685056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509421.848696:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00080000:3.0:1788509421.848747:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509421.848753:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788509422.426361:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788509422.990731:0:13385:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788509423.451236:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509424.470149:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509425.366300:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788509425.366320:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796785024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509425.366431:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509425.366486:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796785024 00000100:00100000:1.0:1788509425.366496:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796785024 00000100:00100000:1.0:1788509425.366551:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788509425.366560:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796785024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509425.366590:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509425.366641:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796785024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509425.366649:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788509425.366748:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796785024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509425.494422:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509425.880373:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796785152:0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.880439:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796785408:0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.880444:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509425.880608:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796785536:0@lo:400:kworker.0 00000100:00100000:2.0:1788509425.880669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796785280:0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.882107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509425.882171:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796785920:0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.882206:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509425.882227:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796786432:0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.882246:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509425.882275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796786944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509425.882300:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509425.882358:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796785920 00000100:00100000:0.0:1788509425.882365:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796785920 00000100:00100000:0.0:1788509425.882417:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796786432 00000100:00100000:0.0:1788509425.882420:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796786432 00000100:00100000:0.0:1788509425.882443:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788509425.882451:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796785920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.882504:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796785920:12345-0@lo:400:kworker.0 Request processed in 53us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509425.882511:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788509425.882525:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788509425.882531:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796786432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.882578:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796786432:12345-0@lo:400:kworker.0 Request processed in 47us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509425.882584:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788509425.882602:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796786944 00000100:00100000:0.0:1788509425.882606:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796786944 00000100:00100000:0.0:1788509425.882634:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788509425.882639:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796786944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788509425.882663:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509425.882694:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796786944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509425.883692:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796785664:0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.883736:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509425.883764:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796786176:0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.883788:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509425.883816:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796786688:0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.883836:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509425.884198:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796785408 00000100:00100000:1.0:1788509425.884205:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796785408 00000100:00100000:1.0:1788509425.884245:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796785664 00000100:00100000:1.0:1788509425.884248:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796785664 00000100:00100000:1.0:1788509425.884341:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788509425.884361:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796785408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.884418:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796785408:12345-0@lo:400:kworker.0 Request processed in 59us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509425.884425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788509425.884451:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788509425.884457:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796785664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.884491:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796785664:12345-0@lo:400:kworker.0 Request processed in 35us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509425.884498:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788509425.884516:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796786176 00000100:00100000:1.0:1788509425.884520:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796786176 00000100:00100000:1.0:1788509425.885678:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796786688 00000100:00100000:1.0:1788509425.885686:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796786688 00000100:00100000:1.0:1788509425.885724:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788509425.885733:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796786176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.885799:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796786176:12345-0@lo:400:kworker.0 Request processed in 67us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509425.885806:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788509425.885827:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788509425.885833:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796786688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.885860:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796786688:12345-0@lo:400:kworker.0 Request processed in 28us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509425.885865:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788509425.888015:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788509425.888060:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509425.888065:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509425.888069:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788509425.888125:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787ca80 x1875387796786944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509425.888151:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796786944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509425.888166:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796785408:0@lo:400:kworker.0 00010000:00080000:0.0:1788509425.888180:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119d880 x1875387796785920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509425.888190:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796785920:0@lo:400:kworker.0 00010000:00080000:0.0:1788509425.888202:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119df80 x1875387796786432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509425.888211:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796786432:0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.888300:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796785152 00000100:00100000:0.0:1788509425.888307:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796785152 00000100:00100000:0.0:1788509425.888412:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788509425.888422:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796785152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.888492:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796785152:12345-0@lo:400:kworker.0 Request processed in 72us (8046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509425.888499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788509425.888660:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796785664:0@lo:400:kworker.0 00010000:00080000:1.0:1788509425.888680:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119e680 x1875387796786176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509425.888681:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509425.888702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796786176:0@lo:400:kworker.0 00010000:00080000:1.0:1788509425.888715:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78aed80 x1875387796786688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509425.888722:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796786688:0@lo:400:kworker.0 00000100:00100000:3.0:1788509425.888725:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796786048:0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.888731:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796785152:0@lo:400:kworker.0 00000100:00100000:3.0:1788509425.888755:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509425.888770:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796786560:0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.888777:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796786048 00000100:00100000:1.0:1788509425.888781:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796786048 00000100:00100000:3.0:1788509425.888789:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509425.888805:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796787072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509425.888818:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796786560 00000100:00100000:1.0:1788509425.888821:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796786560 00000100:00100000:3.0:1788509425.888825:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509425.888837:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788509425.888843:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796786048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509425.888854:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796787072 00000100:00100000:3.0:1788509425.888857:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796787072 00000100:00100000:3.0:1788509425.888881:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788509425.888884:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796786048:12345-0@lo:400:kworker.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509425.888886:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796787072:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509425.888890:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00000024:3.0:1788509425.888933:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509425.888969:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796787072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509425.888975:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788509425.889005:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796787072:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788509425.889025:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119e300 x1875387796786048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509425.889034:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796786048:0@lo:400:kworker.0 00000100:00100000:3.0:1788509425.889064:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788509425.889072:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796786560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509425.889105:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796786560:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509425.889112:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788509425.889129:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788509425.889144:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119f100 x1875387796786560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509425.889154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796786560:0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.897238:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796785536 00000100:00100000:0.0:1788509425.897252:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796785536 00000100:00100000:0.0:1788509425.897328:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788509425.897338:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796785536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509425.897443:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796785536:12345-0@lo:400:kworker.0 Request processed in 106us (8760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509425.897450:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788509425.900251:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509425.900308:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796785792:0@lo:400:kworker.0 00000100:00100000:2.0:1788509425.900358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509425.900390:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796785280 00000100:00100000:2.0:1788509425.900397:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796785280 00000100:00100000:2.0:1788509425.900434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796785792 00000100:00100000:2.0:1788509425.900436:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796785792 00000100:00100000:2.0:1788509425.900461:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788509425.900468:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796785280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509425.900514:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796785280:12345-0@lo:400:kworker.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509425.900520:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788509425.900536:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788509425.900542:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796785792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509425.900568:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796785792:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509425.900573:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788509425.900610:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796785792:0@lo:400:kworker.0 00000100:00100000:2.0:1788509425.900619:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796786304:0@lo:400:kworker.0 00000100:00100000:2.0:1788509425.900640:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509425.900659:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796786304 00000100:00100000:2.0:1788509425.900663:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796786304 00000100:00100000:2.0:1788509425.900686:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788509425.900874:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796786304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509425.900930:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796786304:12345-0@lo:400:kworker.0 Request processed in 49us (280us total) trans 0 rc 0/0 00000100:00080000:3.0:1788509425.900969:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509425.901073:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796786304:0@lo:400:kworker.0 00000100:00100000:3.0:1788509425.901081:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796786816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509425.901120:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509425.901162:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796785280:0@lo:400:kworker.0 00000100:00100000:1.0:1788509425.901350:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796786816 00000100:00100000:1.0:1788509425.901355:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796786816 00000100:00100000:1.0:1788509425.901394:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788509425.901402:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796786816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509425.901417:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509425.901462:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796786816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509425.901468:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788509425.901512:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796785536:0@lo:400:kworker.0 00010000:00080000:3.0:1788509425.901590:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787d180 x1875387796786816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509425.901607:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796786816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509425.904282:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788509426.390163:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509426.390186:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796787200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509426.390254:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509426.391579:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796787200 00000100:00100000:0.0:1788509426.391591:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796787200 00000100:00100000:0.0:1788509426.391652:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788509426.391663:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796787200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509426.391693:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509426.391761:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796787200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509426.391768:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788509426.391811:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb789b800 x1875387796787200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509426.391831:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796787200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509426.392017:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509426.392030:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796787328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509426.392073:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509426.392161:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796787328 00000100:00100000:1.0:1788509426.392178:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796787328 00000100:00100000:1.0:1788509426.392215:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788509426.392222:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796787328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788509426.392233:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509426.392271:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796787328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509426.392278:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788509426.392552:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7898a80 x1875387796787328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509426.392567:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796787328:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788509426.522733:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509426.964783:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509426.964823:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509426.964848:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509426.964872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509426.964913:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509426.964952:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774685440 00000100:00100000:2.0:1788509426.964961:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774685440 00000100:00100000:2.0:1788509426.965014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774685696 00000100:00100000:2.0:1788509426.965017:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774685696 00000100:00100000:2.0:1788509426.965031:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774685312 00000100:00100000:2.0:1788509426.965033:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774685312 00000100:00100000:2.0:1788509426.965045:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774685568 00000100:00100000:2.0:1788509426.965048:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774685568 00000100:00100000:2.0:1788509426.965064:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1788509426.965073:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774685440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509426.965156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774685440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509426.965179:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1788509426.965198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:2.0:1788509426.965204:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774685696:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509426.965231:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774685696:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509426.965237:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:2.0:1788509426.965248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:2.0:1788509426.965254:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774685312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509426.965277:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774685312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509426.965283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:2.0:1788509426.965294:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1788509426.965300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774685568:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509426.965335:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774685568:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509426.965341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00080000:2.0:1788509426.965366:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509426.965370:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509426.969211:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774685184 00000100:00100000:1.0:1788509426.969227:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774685184 00000100:00100000:1.0:1788509426.969293:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 331 00000100:00100000:1.0:1788509426.969302:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774685184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509426.969371:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774685184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (4598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509426.969378:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 331 00010000:00010000:0.0:1788509427.548815:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509428.566315:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509429.595660:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788509430.166507:0:13534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:10:27 (1788509427) === 00000100:00100000:2.0:1788509430.451169:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509430.451209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509430.451265:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774685952 00000100:00100000:0.0:1788509430.451274:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774685952 00000100:00100000:0.0:1788509430.451335:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788509430.451345:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:10497:x1875387774685952:12345-192.168.203.12@tcp:700:mkdir.0 00000100:00100000:0.0:1788509430.451451:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:10497:x1875387774685952:12345-192.168.203.12@tcp:700:mkdir.0 Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509430.451459:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00080000:2.0:1788509430.451504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509430.451734:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774685824 00000100:00100000:3.0:1788509430.451739:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774685824 00000100:00100000:3.0:1788509430.451773:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788509430.451781:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774685824:12345-192.168.203.12@tcp:41:mkdir.0 00000004:00000024:3.0:1788509430.451804:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509430.452019:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774685824:12345-192.168.203.12@tcp:41:mkdir.0 Request processed in 237us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509430.452036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788509430.471331:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509430.478622:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774686208 00000100:00100000:0.0:1788509430.478637:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774686208 00000100:00100000:0.0:1788509430.478705:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788509430.478716:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:10497:x1875387774686208:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:0.0:1788509430.478765:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509430.478843:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dd87c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f7d expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.478859:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcda03cf900) 00010000:00010000:0.0:1788509430.478870:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509430.479148:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479162:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479171:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479199:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479224:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479240:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479684:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479694:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479701:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509430.479716:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008252fdf0 reply state 000000005b935f4d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479727:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479732:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcc865bbb00) 00010000:00010000:0.0:1788509430.479735:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509430.479738:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788509430.479742:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788509430.479749:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479756:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479762:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479776:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509430.479780:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.479788:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.480057:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bbd00) 00010000:00010000:0.0:1788509430.480062:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509430.480067:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.480074:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dd9da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509430.480090:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008252fdf0 reply state 000000005b935f4d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.480099:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.480105:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8bcc865bb100) 00010000:00010000:0.0:1788509430.480107:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509430.480110:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788509430.480233:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:10497:x1875387774686208:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 1511us (8902us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788509430.480241:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788509430.487154:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788509430.487178:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796787456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509430.487259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509430.487435:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796787456 00000100:00100000:0.0:1788509430.487443:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796787456 00000100:00100000:0.0:1788509430.487498:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788509430.487523:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796787456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788509430.487557:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788509430.487654:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796787456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509430.487661:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788509430.487735:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796787456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509430.506452:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509430.506532:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774686336 00000100:00100000:3.0:1788509430.506553:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774686336 00000100:00100000:3.0:1788509430.506612:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788509430.506634:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:10498:x1875387774686336:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:3.0:1788509430.506654:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509430.506676:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dd9ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553010 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.506734:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310dd9f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.506748:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310dd9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.506760:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310dd9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509430.506800:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788509430.506803:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788509430.506839:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310dd9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.506864:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dd9ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553010 expref: 9 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.506880:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310dd9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553010 expref: 8 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.506888:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcd8399b400) 00010000:00010000:3.0:1788509430.507207:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788509430.507212:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4b800, rc 0) 00000100:00100000:0.0:1788509430.507379:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:10498:x1875387774686336:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 745us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509430.507387:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788509430.515332:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509430.515408:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774686592 00000100:00100000:2.0:1788509430.515418:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774686592 00000100:00100000:2.0:1788509430.515528:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788509430.515539:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:10498:x1875387774686592:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:2.0:1788509430.515589:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509430.515616:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310dd9f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553010 expref: 8 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.515634:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcd8399b400) 00010000:00010000:2.0:1788509430.515650:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509430.515687:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.515700:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.515710:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788509430.515889:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000102d2b01 reply state 000000001a9046ab transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.515946:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.515953:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcdbd03f500) 00010000:00010000:2.0:1788509430.515955:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788509430.515959:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788509430.515966:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788509430.517158:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:10498:x1875387774686592:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 1615us (1829us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788509430.517168:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788509430.580361:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509430.580448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774686720 00000100:00100000:3.0:1788509430.580457:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774686720 00000100:00100000:3.0:1788509430.580527:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788509430.580537:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:10499:x1875387774686720:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:3.0:1788509430.580558:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509430.580576:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553017 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.580638:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310dda0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.580653:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310dda0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.580664:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310dda0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509430.580703:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788509430.580707:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788509430.580742:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310dda0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.580765:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553017 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.580784:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310dda0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553017 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.580804:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcdbd03f500) 00010000:00010000:3.0:1788509430.580807:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788509430.580810:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4be00, rc 0) 00000100:00100000:3.0:1788509430.580870:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:10499:x1875387774686720:12345-192.168.203.12@tcp:101:chown.0 Request processed in 334us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509430.580884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1788509430.587140:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509430.587232:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774686848 00000100:00100000:0.0:1788509430.587241:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774686848 00000100:00100000:0.0:1788509430.587299:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788509430.587308:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:10499:x1875387774686848:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:0.0:1788509430.587328:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509430.587348:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755301e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587411:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587426:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587439:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587449:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587473:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587480:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587540:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310dda27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587549:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310dda27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587556:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310dda27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509430.587593:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788509430.587597:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509430.587615:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310dda27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587627:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587633:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587640:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587646:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509430.587651:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587664:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587677:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcdbd03f500) 00010000:00010000:0.0:1788509430.587680:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509430.587684:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587691:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587704:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587711:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587716:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587721:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509430.587724:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587729:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587736:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8bcc865bb100) 00010000:00010000:0.0:1788509430.587738:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509430.587741:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587757:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587782:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755301e expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587805:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310dda27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755301e expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.587813:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcc865bbb00) 00010000:00010000:0.0:1788509430.587815:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509430.587818:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590aa00, rc 0) 00000100:00100000:0.0:1788509430.587876:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:10499:x1875387774686848:12345-192.168.203.12@tcp:101:chown.0 Request processed in 568us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509430.587884:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788509430.594343:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509430.594471:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774686976 00000100:00100000:0.0:1788509430.594480:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774686976 00000100:00100000:0.0:1788509430.594533:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788509430.594542:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:10499:x1875387774686976:12345-192.168.203.12@tcp:900:chown.0 00000100:00100000:0.0:1788509430.594619:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:10499:x1875387774686976:12345-192.168.203.12@tcp:900:chown.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509430.594627:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788509430.598569:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509430.598712:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774687232 00000100:00100000:3.0:1788509430.598725:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774687232 00000100:00100000:3.0:1788509430.598790:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1788509430.598802:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:10499:x1875387774687232:12345-192.168.203.12@tcp:36:chown.0 00010000:00010000:3.0:1788509430.599057:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509430.599092:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310dda27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755301e expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.599116:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcc865bbb00) 00010000:00010000:3.0:1788509430.599122:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509430.599153:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.599169:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.599182:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.614199:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788509430.618205:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1788509430.618379:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087a4c053 reply state 00000000ec1f52fb transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.618405:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.618432:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcc865bbb00) 00010000:00010000:0.0:1788509430.618435:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788509430.618440:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788509430.618453:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788509430.618557:0:6521:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788509430.618581:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:10499:x1875387774687232:12345-192.168.203.12@tcp:36:chown.0 Request processed in 19779us (20025us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788509430.618589:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00010000:00010000:2.0:1788509430.618678:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618694:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618703:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618710:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509430.618716:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618726:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618745:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8bcc865bb100) 00010000:00010000:2.0:1788509430.618748:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509430.618753:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618760:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310dd9e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618796:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618803:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618825:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618832:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509430.618836:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618842:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618850:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcc865bbb00) 00010000:00010000:2.0:1788509430.618853:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509430.618856:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618863:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dd9e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618877:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.618883:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.619594:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.619600:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509430.619603:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.619623:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.619635:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcdbd03f500) 00010000:00010000:2.0:1788509430.619638:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788509430.619642:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.619648:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dd9fd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.619814:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.619823:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.619830:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.619841:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509430.619845:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.619851:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.619861:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcc865bbb00) 00010000:00010000:3.0:1788509430.619863:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788509430.619867:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.619874:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda2e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509430.636337:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509430.636463:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774687360 00000100:00100000:0.0:1788509430.636476:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774687360 00000100:00100000:0.0:1788509430.636610:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788509430.636623:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:10500:x1875387774687360:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:0.0:1788509430.636652:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509430.636678:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553025 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788509430.639633:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2891us 00010000:00010000:2.0:1788509430.685613:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.685644:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.685658:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.685676:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.685683:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.685689:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.685864:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dda4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.685873:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dda4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.685880:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dda4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509430.685963:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788509430.685967:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509430.686011:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dda4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686025:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686033:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686041:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686047:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509430.686052:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686060:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686073:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcdbd03f500) 00010000:00010000:2.0:1788509430.686081:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509430.686087:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686094:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dda3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686108:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686115:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686120:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686125:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509430.686129:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686135:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686142:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8bcdbd03f600) 00010000:00010000:2.0:1788509430.686145:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509430.686148:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686153:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dda43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686578:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553025 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686610:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dda4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553025 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.686619:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03fe00) 00010000:00010000:2.0:1788509430.686622:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788509430.686624:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226400, rc 0) 00000100:00100000:2.0:1788509430.686755:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:10500:x1875387774687360:12345-192.168.203.12@tcp:101:touch.500 Request processed in 50134us (50430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509430.686766:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1788509430.700850:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509430.701095:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774687616 00000100:00100000:0.0:1788509430.701108:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774687616 00000100:00100000:0.0:1788509430.701186:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1788509430.701198:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:10500:x1875387774687616:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:0.0:1788509430.701224:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509430.701250:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755302c expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.701400:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.701498:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.701512:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.703501:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.703525:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.703536:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788509430.703927:0:9006:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788509430.704058:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704067:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704075:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704102:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704109:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704116:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704127:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509430.704132:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704139:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704150:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03fe00) 00010000:00010000:0.0:1788509430.704153:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509430.704157:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704163:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dda58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509430.704175:0:9006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e9cd4d5 reply state 00000000e36ae801 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704183:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704189:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8bcc865bbd00) 00010000:00010000:0.0:1788509430.704192:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509430.704194:0:9006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788509430.704224:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310dda51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755302c expref: 10 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704237:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755302c expref: 9 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.704254:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc865bbb00) 00010000:00010000:0.0:1788509430.704256:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509430.704259:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b600, rc 0) 00000100:00100000:0.0:1788509430.704328:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:10500:x1875387774687616:12345-192.168.203.12@tcp:101:touch.500 Request processed in 3131us (3490us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788509430.707483:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1788509430.709418:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509430.709500:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774687872 00000100:00100000:1.0:1788509430.709514:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774687872 00000100:00100000:1.0:1788509430.709591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788509430.709602:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:10500:x1875387774687872:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:1.0:1788509430.709676:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509430.709709:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b600/0xe5156b86310dda66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755302c expref: 10 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.709734:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc865bbb00) 00010000:00010000:1.0:1788509430.709745:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509430.709857:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.709874:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.709884:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509430.710045:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000815fcc1d reply state 000000003477a875 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.710058:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.710065:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc8761eb00) 00010000:00010000:1.0:1788509430.710069:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509430.710072:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788509430.710177:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:10500:x1875387774687872:12345-192.168.203.12@tcp:36:touch.500 Request processed in 576us (774us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788509430.710186:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1788509430.714635:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509430.714785:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774688000 00000100:00100000:3.0:1788509430.714806:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774688000 00000100:00100000:3.0:1788509430.714871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788509430.714882:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:10500:x1875387774688000:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:3.0:1788509430.714943:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509430.714975:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553033 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.715153:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553033 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.715172:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553033 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.715194:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc8761eb00) 00010000:00010000:2.0:1788509430.715197:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509430.715202:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4ae00, rc 0) 00000100:00100000:2.0:1788509430.715281:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:10500:x1875387774688000:12345-192.168.203.12@tcp:101:touch.500 Request processed in 400us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509430.715289:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788509430.724091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509430.724249:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774688128 00000100:00100000:0.0:1788509430.724272:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774688128 00000100:00100000:0.0:1788509430.724328:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788509430.724526:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875387774688128:12345-192.168.203.12@tcp:8:touch.500 00010000:00080000:0.0:1788509430.724561:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:0.0:1788509430.724592:0:8438:0:(genops.c:1385:class_connect()) connect: client d1c7a223-cc58-4f2c-be22-e37eba96eeae, cookie 0xe5156b86310dda82 00002000:00100000:0.0:1788509430.724603:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d1c7a223-cc58-4f2c-be22-e37eba96eeae/ffff8bcc810b5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788509430.724620:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788509430.724692:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788509430.724723:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509430.724793:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2406:x1875387774688128:12345-192.168.203.12@tcp:8:touch.500 Request processed in 455us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509430.724800:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788509430.734026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509430.734132:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774688256 00000100:00100000:1.0:1788509430.734148:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774688256 00000100:00100000:1.0:1788509430.734319:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788509430.734334:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:0:x1875387774688256:12345-192.168.203.12@tcp:2:touch.500 00000100:00080000:2.0:1788509430.736118:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788509430.741011:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1788509430.741033:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000100:00100000:1.0:1788509430.741535:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:0:x1875387774688256:12345-192.168.203.12@tcp:2:touch.500 Request processed in 7198us (7510us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788509430.741549:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788509430.744439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509430.748470:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774688512 00000100:00100000:3.0:1788509430.748489:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774688512 00000100:00100000:3.0:1788509430.749495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788509430.749515:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:10500:x1875387774688512:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:2.0:1788509430.750604:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:10500:x1875387774688512:12345-192.168.203.12@tcp:35:touch.500 Request processed in 1091us (6171us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788509430.754692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788509430.783387:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509430.783565:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774688640 00000100:00100000:1.0:1788509430.783577:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774688640 00000100:00100000:1.0:1788509430.784009:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788509430.784023:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:10501:x1875387774688640:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1788509430.784055:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509430.784080:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310dda89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755303a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.784162:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8a00/0xe5156b86310dda90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.784180:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8a00/0xe5156b86310dda90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.784194:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8a00/0xe5156b86310dda90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509430.784252:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788509430.784256:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509430.784300:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8a00/0xe5156b86310dda90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.784331:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310dda89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755303a expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.784353:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8a00/0xe5156b86310dda90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755303a expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.784363:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03fe00) 00010000:00010000:1.0:1788509430.784366:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788509430.784371:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8a00, rc 0) 00000100:00100000:1.0:1788509430.784461:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:10501:x1875387774688640:12345-192.168.203.12@tcp:101:rm.0 Request processed in 442us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509430.784478:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788509430.793633:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509430.800170:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774688896 00000100:00100000:2.0:1788509430.800190:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774688896 00000100:00100000:3.0:1788509430.809206:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788509430.813720:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:10501:x1875387774688896:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1788509430.813757:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509430.813791:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310dda97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553041 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509430.813960:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788509430.814164:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310dda97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553041 expref: 16 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.814182:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcdbd03f500) 00010000:00010000:3.0:1788509430.814186:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788509430.814192:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310dda97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553041 expref: 16 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.814215:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4b200, rc 0) 00000100:00100000:3.0:1788509430.814417:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:10501:x1875387774688896:12345-192.168.203.12@tcp:101:rm.0 Request processed in 5195us (20800us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788509430.814428:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788509430.819823:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509430.821269:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774689024 00000100:00100000:2.0:1788509430.821286:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774689024 00000100:00100000:2.0:1788509430.821369:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788509430.821381:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:10501:x1875387774689024:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:2.0:1788509430.837850:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:10501:x1875387774689024:12345-192.168.203.12@tcp:37:rm.0 Request processed in 16455us (18027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509430.837869:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788509430.846460:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509430.846615:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774689280 00000100:00100000:3.0:1788509430.846629:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774689280 00000100:00100000:3.0:1788509430.846703:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788509430.846716:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:10501:x1875387774689280:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:3.0:1788509430.847052:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:10501:x1875387774689280:12345-192.168.203.12@tcp:35:rm.0 Request processed in 338us (604us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788509430.847078:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788509430.870115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509430.871478:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774689536 00000100:00100000:1.0:1788509430.871509:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774689536 00000100:00100000:1.0:1788509430.871597:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788509430.871610:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:10501:x1875387774689536:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1788509430.871643:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509430.871670:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9e00/0xe5156b86310ddaa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553048 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.871809:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9800/0xe5156b86310ddaac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.871827:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9800/0xe5156b86310ddaac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.871844:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9800/0xe5156b86310ddaac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509430.871858:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788509430.872035:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9e00/0xe5156b86310ddaa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553048 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.872056:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9800/0xe5156b86310ddaac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553048 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.872065:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03fe00) 00010000:00010000:1.0:1788509430.872069:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788509430.872089:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9800, rc 0) 00000100:00100000:1.0:1788509430.872169:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:10501:x1875387774689536:12345-192.168.203.12@tcp:101:rm.0 Request processed in 562us (2069us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788509430.872176:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788509430.882099:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509430.882662:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774689664 00000100:00100000:2.0:1788509430.882676:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774689664 00000100:00100000:2.0:1788509430.882805:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788509430.882818:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:10501:x1875387774689664:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:2.0:1788509430.882937:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788509430.883019:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:10501:x1875387774689664:12345-192.168.203.12@tcp:41:rm.0 Request processed in 204us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509430.883025:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788509430.891593:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509430.891701:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774689792 00000100:00100000:1.0:1788509430.891714:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774689792 00000100:00100000:1.0:1788509430.891790:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1788509430.891802:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:10501:x1875387774689792:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1788509430.891828:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509430.891855:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9e00/0xe5156b86310ddaba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755304f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.891990:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892008:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892022:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892035:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892042:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892049:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892162:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8000/0xe5156b86310ddacf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892187:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8000/0xe5156b86310ddacf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892195:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8000/0xe5156b86310ddacf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509430.892250:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788509430.892255:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509430.892276:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8000/0xe5156b86310ddacf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892290:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8000/0xe5156b86310ddacf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892300:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892307:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892313:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892319:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509430.892324:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892332:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892346:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03fe00) 00010000:00010000:1.0:1788509430.892349:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509430.892361:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892368:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddac1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892387:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892393:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892397:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892403:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509430.892406:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892411:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892418:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8bcc865bbd00) 00010000:00010000:1.0:1788509430.892421:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509430.892424:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892429:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddac8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892459:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9e00/0xe5156b86310ddaba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755304f expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892486:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8000/0xe5156b86310ddacf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755304f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509430.892513:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc8761eb00) 00010000:00010000:1.0:1788509430.892516:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509430.892518:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8000, rc 0) 00000100:00100000:1.0:1788509430.892593:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:10501:x1875387774689792:12345-192.168.203.12@tcp:101:rm.0 Request processed in 792us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509430.892601:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1788509430.901844:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509430.902168:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774690048 00000100:00100000:3.0:1788509430.902182:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774690048 00000100:00100000:3.0:1788509430.902262:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1788509430.902271:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:10501:x1875387774690048:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:3.0:1788509430.902335:0:9006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788509430.902366:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8000/0xe5156b86310ddacf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755304f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902391:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310dda7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553033 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902405:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc8761eb00) 00010000:00010000:3.0:1788509430.902416:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8a00/0xe5156b86310dda90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755303a expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902424:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03fe00) 00010000:00010000:3.0:1788509430.902427:0:9006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509430.902453:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902469:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902479:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902731:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902740:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902747:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902865:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902875:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.902883:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788509430.903336:0:9006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788509430.903348:0:9006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328064448760ns, next at 329064445538ns, rc = 0 00010000:00010000:3.0:1788509430.903402:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903412:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903419:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903426:0:9006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903444:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903449:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903472:0:9006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509430.903493:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903500:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903703:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903709:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4a000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509430.903714:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903723:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903735:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc8761eb00) 00010000:00010000:3.0:1788509430.903738:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788509430.903742:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903748:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddae4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903767:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903780:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903786:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903792:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4b200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509430.903795:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903801:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903809:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03fe00) 00010000:00010000:3.0:1788509430.903812:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509430.903815:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903820:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b200/0xe5156b86310ddad6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788509430.903834:0:9006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002040f3a4 reply state 0000000052b7122d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903846:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509430.903852:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8bcc865bbd00) 00010000:00010000:3.0:1788509430.903855:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788509430.903859:0:9006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788509430.907731:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509430.907774:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.907788:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4b800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509430.907793:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.907805:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.907829:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc8761eb00) 00010000:00010000:0.0:1788509430.907833:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788509430.907839:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.907846:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddaeb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509430.907871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509430.907873:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509430.907875:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509430.918327:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:10501:x1875387774690048:12345-192.168.203.12@tcp:36:rm.0 Request processed in 16039us (16480us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788509430.918345:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788509430.921262:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509430.921340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774690304 00000100:00100000:3.0:1788509430.921368:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774690304 00000100:00100000:3.0:1788509430.921436:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788509430.921449:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:10501:x1875387774690304:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:3.0:1788509430.921733:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:10501:x1875387774690304:12345-192.168.203.12@tcp:35:rm.0 Request processed in 285us (484us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788509430.921742:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788509430.932288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509430.932459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774690560 00000100:00100000:2.0:1788509430.932490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774690560 00000100:00100000:2.0:1788509430.932570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788509430.932582:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:10501:x1875387774690560:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1788509430.932660:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788509430.932694:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9800/0xe5156b86310ddaac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553048 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.932723:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dda4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553025 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.932739:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03fe00) 00010000:00010000:2.0:1788509430.932762:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310dda0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553017 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.932775:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcdbd03f500) 00010000:00010000:2.0:1788509430.932783:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509430.932815:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.932830:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.932842:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.932856:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.932864:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.932883:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933052:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933061:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933069:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509430.933362:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788509430.933381:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933389:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933396:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933402:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509430.933407:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933416:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933426:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bcdbd03f800) 00010000:00010000:2.0:1788509430.933429:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788509430.933442:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933449:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddb00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933472:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933478:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933483:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933489:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509430.933492:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933499:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933507:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcdbd03f600) 00010000:00010000:2.0:1788509430.933509:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509430.933512:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933517:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddaf2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788509430.933529:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008eee1297 reply state 000000001da4dc27 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933553:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509430.933559:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8bcdbd03f200) 00010000:00010000:2.0:1788509430.933561:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788509430.933564:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788509430.933667:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:10501:x1875387774690560:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1086us (1392us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788509430.933676:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788509430.998710:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509430.998739:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796787712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509431.001550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796787584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509431.002179:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796788224:0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.002484:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509431.002676:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796787840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509431.002754:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509431.002785:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796788352:0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.002811:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509431.002831:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796788864:0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.002878:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509431.002927:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796789376:0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.002949:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509431.002992:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796788864 00000100:00100000:0.0:1788509431.003948:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796788864 00000100:00100000:0.0:1788509431.004089:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796789376 00000100:00100000:0.0:1788509431.004093:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796789376 00000100:00100000:0.0:1788509431.004116:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788509431.004126:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796788864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.004190:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796788864:12345-0@lo:400:kworker.0 Request processed in 66us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509431.004198:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788509431.004214:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788509431.004221:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796789376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.004248:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796789376:12345-0@lo:400:kworker.0 Request processed in 28us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509431.004253:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788509431.004273:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509431.004277:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788509431.004306:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787a300 x1875387796788864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509431.004335:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796788864:0@lo:400:kworker.0 00010000:00080000:0.0:1788509431.004353:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87d48380 x1875387796789376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509431.004364:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796789376:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.004384:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796787968:0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.004424:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509431.004483:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509431.004545:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796788480:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.004577:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509431.004611:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796788992:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.004638:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509431.004656:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796789504:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.004678:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509431.004704:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788509431.004712:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796788096:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.004744:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509431.004811:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509431.004844:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796788736:0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.004883:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796787840 00000100:00100000:3.0:1788509431.004910:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796787840 00000100:00100000:3.0:1788509431.004947:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796788480 00000100:00100000:3.0:1788509431.004950:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796788480 00000100:00100000:3.0:1788509431.004962:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796788224 00000100:00100000:3.0:1788509431.004965:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796788224 00000100:00100000:3.0:1788509431.004976:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788509431.004983:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1875387796787840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509431.005013:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509431.009034:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1875387796787840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4041us (6269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.009049:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788509431.009096:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788509431.009110:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796788480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.009614:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796788480:12345-0@lo:400:kworker.0 Request processed in 510us (5035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.009621:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788509431.009647:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788509431.009654:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796788224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.009775:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796788224:12345-0@lo:400:kworker.0 Request processed in 122us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.009781:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788509431.009806:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796788992 00000100:00100000:3.0:1788509431.009813:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796788992 00000100:00100000:3.0:1788509431.009855:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796789504 00000100:00100000:3.0:1788509431.009858:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796789504 00000100:00100000:3.0:1788509431.009871:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788509431.009876:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796788992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.009991:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796788992:12345-0@lo:400:kworker.0 Request processed in 114us (5352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.009997:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788509431.010007:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788509431.010012:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796789504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.010038:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796789504:12345-0@lo:400:kworker.0 Request processed in 26us (5359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.010045:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788509431.010522:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509431.010528:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509431.010966:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796788352 00000100:00100000:3.0:1788509431.010973:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796788352 00000100:00100000:3.0:1788509431.011006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796788096 00000100:00100000:3.0:1788509431.011008:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796788096 00000100:00100000:3.0:1788509431.011032:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788509431.011039:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796788352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.011098:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796788352:12345-0@lo:400:kworker.0 Request processed in 59us (8285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.011115:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788509431.011130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788509431.011138:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796788096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.011180:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796788096:12345-0@lo:400:kworker.0 Request processed in 43us (6435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.011186:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788509431.011195:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796787840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509431.011215:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796788352:0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.011253:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796787968 00000100:00100000:3.0:1788509431.011257:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796787968 00000100:00100000:0.0:1788509431.011279:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509431.011290:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788509431.011298:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796787968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.011323:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796789248:0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.011330:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796787968:12345-0@lo:400:kworker.0 Request processed in 33us (6848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.011337:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788509431.011366:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509431.011653:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796788224:0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.011672:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796788736 00000100:00100000:0.0:1788509431.011676:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796788736 00000100:00100000:0.0:1788509431.011707:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796789248 00000100:00100000:0.0:1788509431.011710:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796789248 00000100:00100000:0.0:1788509431.011727:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788509431.011733:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796788736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.011772:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796788736:12345-0@lo:400:kworker.0 Request processed in 38us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509431.011778:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788509431.011790:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788509431.011796:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796789248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.011824:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796789248:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509431.011830:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1788509431.011845:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788509431.011866:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7879f80 x1875387796788736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509431.011877:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796788736:0@lo:400:kworker.0 00010000:00080000:0.0:1788509431.011886:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87d49500 x1875387796789248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509431.011938:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796789248:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.013001:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796788096:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.013039:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796788608:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.013103:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509431.013127:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796789120:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.013150:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509431.013187:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796787968:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.013202:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796788480:0@lo:400:kworker.0 00010000:00080000:1.0:1788509431.013218:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87d48a80 x1875387796788992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509431.015959:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796788608 00000100:00100000:0.0:1788509431.015979:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796788608 00000100:00100000:0.0:1788509431.016065:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796789120 00000100:00100000:0.0:1788509431.016069:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796789120 00000100:00100000:0.0:1788509431.016100:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788509431.016111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796788608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.016220:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796788608:12345-0@lo:400:kworker.0 Request processed in 110us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509431.016427:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796787712 00000100:00100000:2.0:1788509431.016441:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796787712 00000100:00100000:0.0:1788509431.016641:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788509431.016748:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788509431.016829:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796789120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509431.016885:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796789120:12345-0@lo:400:kworker.0 Request processed in 65us (3734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509431.016924:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796787584 00000100:00100000:2.0:1788509431.016932:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796787584 00000100:00100000:0.0:1788509431.016932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788509431.016968:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788509431.016973:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509431.016982:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796787712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509431.017558:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796788992:0@lo:400:kworker.0 00010000:00080000:1.0:1788509431.017594:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87d49180 x1875387796789504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509431.017604:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796789504:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.017648:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796788608:0@lo:400:kworker.0 00000100:00100000:1.0:1788509431.017665:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796789120:0@lo:400:kworker.0 00000100:00100000:3.0:1788509431.018295:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788509431.018312:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796787584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509431.018342:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509431.018435:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796787584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (14011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509431.018442:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788509431.018655:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356d80 x1875387796787584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1788509431.019120:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509431.019166:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796787712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2187us (16688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509431.019174:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788509431.020689:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796787584:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788509431.021836:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119fb80 x1875387796787712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509431.021866:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796787712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509431.510235:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796789632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509431.510313:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509431.510456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796789760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509431.510491:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509431.510537:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796789632 00000100:00100000:1.0:1788509431.510553:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796789632 00000100:00100000:1.0:1788509431.510641:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796789760 00000100:00100000:1.0:1788509431.510645:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796789760 00000100:00100000:1.0:1788509431.510673:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788509431.510706:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796789632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788509431.510739:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509431.510839:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796789632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509431.510848:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788509431.510895:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788509431.510928:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796789760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788509431.510940:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509431.510979:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796789760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509431.510985:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1788509431.511064:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119c000 x1875387796789760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509431.511099:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796789760:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788509431.511176:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87d4b100 x1875387796789632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509431.511190:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796789632:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788509431.638450:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509432.089368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509432.089426:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509432.089457:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509432.089481:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509432.089500:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509432.089528:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509432.089563:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774690816 00000100:00100000:0.0:1788509432.089576:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774690816 00000100:00100000:3.0:1788509432.089985:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774690688 00000100:00100000:3.0:1788509432.089990:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774690688 00000100:00100000:3.0:1788509432.090049:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 333 00000100:00100000:3.0:1788509432.090061:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774690688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509432.090150:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774690688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 91us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509432.090175:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 333 00000100:00100000:1.0:1788509432.090352:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774691328 00000100:00100000:1.0:1788509432.090357:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774691328 00000100:00100000:1.0:1788509432.093266:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774690944 00000100:00100000:1.0:1788509432.093282:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774690944 00000100:00100000:1.0:1788509432.093308:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774691200 00000100:00100000:1.0:1788509432.093311:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774691200 00000100:00100000:0.0:1788509432.095523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:0.0:1788509432.095541:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774691328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509432.096348:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:3.0:1788509432.101117:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774690944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509432.101212:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774690944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 4853us (11709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509432.101224:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:3.0:1788509432.101290:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:0.0:1788509432.101325:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774691328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 5788us (11841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509432.101335:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00080000:0.0:1788509432.101385:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509432.104483:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2409:x1875387774690816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509432.104589:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2409:x1875387774690816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3289us (15162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509432.104813:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:1.0:1788509432.104827:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774691200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509432.104859:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774691200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (15330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509432.104868:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:3.0:1788509432.105221:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1788509432.105369:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774691072 00000100:00100000:1.0:1788509432.105380:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774691072 00000100:00100000:1.0:1788509432.105444:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1788509432.105452:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774691072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509432.105509:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774691072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 58us (16051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509432.105515:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00080000:0.0:1788509432.105924:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509432.105929:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788509432.665605:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509433.714447:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509434.779371:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509435.607583:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509435.607617:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796789888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509435.607713:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509435.607793:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796789888 00000100:00100000:3.0:1788509435.607803:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796789888 00000100:00100000:3.0:1788509435.607870:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788509435.607881:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796789888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509435.607956:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509435.608013:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796789888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509435.608021:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788509435.608075:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796789888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788509435.804096:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509436.120976:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796790400:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.121046:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509436.121105:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796790912:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.121129:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509436.121145:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796791424:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.121164:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509436.121204:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788509436.121211:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796790272:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.121234:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509436.121252:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796790784:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.121272:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509436.121293:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796791296:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.121311:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509436.121334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796790912 00000100:00100000:0.0:1788509436.121341:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796790912 00000100:00100000:2.0:1788509436.121643:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796790016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509436.121675:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509436.121702:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796790528:0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.121735:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509436.121747:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796791040:0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.121768:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509436.121785:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796791552:0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.121803:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509436.121819:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788509436.121824:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796790144:0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.121850:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509436.121883:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796790656:0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.121919:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509436.121936:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796791168:0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.121955:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509436.121971:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796791680:0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.121992:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509436.122022:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796790400 00000100:00100000:2.0:1788509436.122027:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796790400 00000100:00100000:2.0:1788509436.122060:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796790016 00000100:00100000:2.0:1788509436.122062:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796790016 00000100:00100000:2.0:1788509436.122072:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796790656 00000100:00100000:2.0:1788509436.122074:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796790656 00000100:00100000:3.0:1788509436.124663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796791808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509436.124731:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509436.124798:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788509436.124813:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875387796790400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509436.124880:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875387796790400:12345-0@lo:400:kworker.0 Request processed in 73us (3833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509436.124888:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788509436.124929:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788509436.124936:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796790016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509436.124962:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509436.125272:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796790016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (3326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509436.125280:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788509436.125304:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796791424 00000100:00100000:3.0:1788509436.125312:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796791424 00000100:00080000:0.0:1788509436.126335:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509436.130092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796790272 00000100:00100000:0.0:1788509436.130107:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796790272 00000100:00100000:2.0:1788509436.130113:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788509436.130125:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796790656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.130138:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796790784 00000100:00100000:0.0:1788509436.130143:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796790784 00000100:00100000:2.0:1788509436.130204:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796790656:12345-0@lo:400:kworker.0 Request processed in 81us (8284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130210:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788509436.130235:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796790144 00000100:00100000:2.0:1788509436.130246:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796790144 00000100:00100000:2.0:1788509436.130275:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788509436.130281:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796790144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.130316:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796790144:12345-0@lo:400:kworker.0 Request processed in 35us (8465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788509436.130351:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796791296 00000100:00100000:0.0:1788509436.130356:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796791296 00000100:00100000:0.0:1788509436.130373:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796790528 00000100:00100000:0.0:1788509436.130375:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796790528 00000100:00100000:0.0:1788509436.130387:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788509436.130393:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796790272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.130431:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796790272:12345-0@lo:400:kworker.0 Request processed in 38us (9196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509436.130440:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788509436.130448:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796790784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509436.130480:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796790784:12345-0@lo:400:kworker.0 Request processed in 34us (9207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130504:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796791040 00000100:00100000:2.0:1788509436.130508:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796791040 00000100:00100000:2.0:1788509436.130526:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796791552 00000100:00100000:2.0:1788509436.130529:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796791552 00000100:00100000:2.0:1788509436.130539:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796791168 00000100:00100000:2.0:1788509436.130542:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796791168 00000100:00100000:0.0:1788509436.130550:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788509436.130552:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796791680 00000100:00100000:2.0:1788509436.130556:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796791680 00000100:00100000:0.0:1788509436.130573:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788509436.130577:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788509436.130584:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796791296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.130589:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796791040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.130630:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796791040:12345-0@lo:400:kworker.0 Request processed in 45us (8860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130638:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788509436.130639:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796791296:12345-0@lo:400:kworker.0 Request processed in 57us (9324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509436.130649:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788509436.130654:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788509436.130666:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796791552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.130676:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788509436.130685:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796790528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.130701:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796791552:12345-0@lo:400:kworker.0 Request processed in 36us (8896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130708:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788509436.130723:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788509436.130727:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796790528:12345-0@lo:400:kworker.0 Request processed in 42us (8989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130734:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796791168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.130740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788509436.130757:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788509436.130766:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796791424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.130773:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796791168:12345-0@lo:400:kworker.0 Request processed in 40us (8815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130788:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788509436.130806:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788509436.130808:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796791424:12345-0@lo:400:kworker.0 Request processed in 43us (9641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130816:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796791680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.130822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1788509436.130842:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509436.130847:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509436.130850:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509436.130864:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509436.130869:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796791680:12345-0@lo:400:kworker.0 Request processed in 41us (8861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.130877:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788509436.130919:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796790272:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.130939:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796790784:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.130952:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796791296:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.130964:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796790400:0@lo:400:kworker.0 00010000:00080000:0.0:1788509436.131039:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7872a00 x1875387796791424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509436.131051:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796791424:0@lo:400:kworker.0 00000100:00100000:3.0:1788509436.131134:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788509436.131149:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788509436.131156:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796790912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509436.131191:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796790912:12345-0@lo:400:kworker.0 Request processed in 36us (10061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509436.131206:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788509436.131432:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796791808 00000100:00100000:3.0:1788509436.131438:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796791808 00000100:00100000:3.0:1788509436.131466:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788509436.131473:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796791808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509436.131508:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509436.132305:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796791808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 828us (7570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509436.132313:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1788509436.132440:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5c000 x1875387796791808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509436.132460:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796791808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509436.132768:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796791936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509436.132816:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788509436.132876:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876ad180 x1875387796790912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509436.132886:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796790912:0@lo:400:kworker.0 00000100:00100000:3.0:1788509436.132938:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796790144:0@lo:400:kworker.0 00000100:00100000:3.0:1788509436.132954:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796790656:0@lo:400:kworker.0 00010000:00080000:0.0:1788509436.133066:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876aed80 x1875387796791168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509436.133076:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796791168:0@lo:400:kworker.0 00010000:00080000:0.0:1788509436.133102:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7873480 x1875387796791680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509436.133110:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796791680:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.133122:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796790528:0@lo:400:kworker.0 00010000:00080000:0.0:1788509436.133133:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876aea00 x1875387796791040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509436.133142:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796791040:0@lo:400:kworker.0 00000100:00100000:2.0:1788509436.133232:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796791936 00000100:00100000:2.0:1788509436.133239:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796791936 00000100:00100000:2.0:1788509436.133277:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788509436.133286:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796791936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788509436.133304:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509436.133361:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796791936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509436.133368:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788509436.133406:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7871c00 x1875387796791552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509436.133416:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796791552:0@lo:400:kworker.0 00000100:00100000:0.0:1788509436.133437:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796790016:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788509436.134300:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7872a00 x1875387796791936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509436.134318:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796791936:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788509436.134769:0:13681:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1788509436.630175:0:8755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333791273683ns, next at 334791270075ns, rc = 0 00000100:00100000:0.0:1788509436.630176:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796792064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509436.630298:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509436.630390:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796792064 00000100:00100000:0.0:1788509436.630399:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796792064 00000100:00100000:0.0:1788509436.630490:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788509436.630500:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796792064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509436.630590:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509436.630650:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796792064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509436.630658:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1788509436.630876:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356d80 x1875387796792064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509436.630922:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796792064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788509436.632839:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509436.632874:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796792192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509436.632970:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509436.633049:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796792192 00000100:00100000:1.0:1788509436.633057:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796792192 00000100:00100000:1.0:1788509436.633121:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788509436.633132:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796792192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788509436.633153:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509436.633207:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796792192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509436.633217:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788509436.633284:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5d500 x1875387796792192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509436.633305:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796792192:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788509436.647345:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788509436.649311:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788509436.649348:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788509436.650325:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509436.650354:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796792320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788509436.650442:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509436.650527:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796792320 00000100:00100000:3.0:1788509436.650536:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796792320 00000100:00100000:3.0:1788509436.650611:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788509436.650623:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796792320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788509436.650657:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788509436.650703:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9a7cf6, atime: 0x6a9a7cf6, ctime: 0x6a9a7cf6, blocks: 0x0 00010000:00010000:3.0:1788509436.650712:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509436.650732:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1788509436.650737:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509436.650745:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509436.650765:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509436.650777:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509436.650786:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509436.650803:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788509436.651068:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796792320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 446us (625us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788509436.651076:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1788509436.651141:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcc87356d80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788509436.651148:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796792320:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788509436.654209:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509436.654230:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509436.654248:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4a000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509436.654254:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509436.654267:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509436.654300:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509436.654309:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002db334e1/0xe5156b86310ddb07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509436.654342:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509436.654344:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509436.654346:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509436.656074:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656096:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656106:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656143:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509436.656149:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656158:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656180:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8bcc865bbd00) 00010000:00010000:1.0:1788509436.656183:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509436.656298:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656307:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dda5f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656341:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656347:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656353:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656358:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509436.656361:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656367:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656442:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bcc8761eb00) 00010000:00010000:1.0:1788509436.656446:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509436.656451:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656457:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310dda74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656483:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656490:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656496:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656501:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4ac00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509436.656504:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656570:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656583:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff8bcc865bbd00) 00010000:00010000:1.0:1788509436.656586:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509436.656590:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656596:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddadd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656629:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656637:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656643:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656648:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509436.656652:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656658:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656666:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8bcdbd03f200) 00010000:00010000:1.0:1788509436.656668:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509436.656671:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509436.656676:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddaf9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509436.822629:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509437.210334:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509437.210382:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509437.210415:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509437.210441:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774691584 00000100:00100000:3.0:1788509437.210442:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509437.210454:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774691584 00000100:00100000:3.0:1788509437.210458:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509437.210479:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509437.210502:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774692096 00000100:00100000:3.0:1788509437.210506:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774692096 00000100:00100000:2.0:1788509437.210523:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774691712 00000100:00100000:3.0:1788509437.210526:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774691968 00000100:00100000:2.0:1788509437.210526:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774691712 00000100:00100000:3.0:1788509437.210528:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774691968 00000100:00100000:3.0:1788509437.210547:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:3.0:1788509437.210564:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774691584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509437.210662:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774691584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 100us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509437.210737:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774691456 00000100:00100000:0.0:1788509437.210741:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774691456 00000100:00100000:0.0:1788509437.210783:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 335 00000100:00100000:0.0:1788509437.210791:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774691456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509437.210819:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774691456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509437.210858:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 335 00000100:00100000:2.0:1788509437.212338:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1788509437.212375:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774692096:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509437.212465:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774692096:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 114us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509437.212486:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1788509437.212521:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:2.0:1788509437.212529:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774691712:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509437.212555:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774691712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509437.212561:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:2.0:1788509437.212575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:2.0:1788509437.212582:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774691968:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509437.212842:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774691968:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 260us (2361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509437.212858:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:2.0:1788509437.212894:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774691840 00000100:00100000:2.0:1788509437.212919:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774691840 00000100:00100000:2.0:1788509437.212970:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:2.0:1788509437.212977:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774691840:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509437.213071:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774691840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509437.213078:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00080000:2.0:1788509437.213103:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509437.213108:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509437.213112:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509437.216073:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000020:00000080:2.0:1788509437.444706:0:13731:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe5be6250 20000000:00000080:2.0:1788509437.444728:0:13731:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bcc87787400 uarg=0000000000000000 20000000:01000000:2.0:1788509437.444858:0:13731:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788509437.444875:0:13731:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788509437.444882:0:13731:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788509437.445751:0:13732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788509437.446271:0:13731:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788509437.452388:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788509437.452433:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788509437.452450:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788509437.452468:0:13731:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788509437.452492:0:13731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452515:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd994 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452523:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452530:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452537:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dd9be expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452548:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452555:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452563:0:13731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452617:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452655:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 12 pid: 6515 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.452674:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792448:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509437.452815:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452824:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 12 pid: 6514 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.452833:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792576:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509437.452880:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd9be expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.452890:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd9be expref: 23 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.452943:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792704:0@lo:104: 00000100:00100000:2.0:1788509437.452995:0:13731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509437.453029:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.453037:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 23 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.453045:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792832:0@lo:104: 00010000:00010000:2.0:1788509437.453073:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.453087:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 23 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.453095:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792960:0@lo:104: 00010000:00010000:2.0:1788509437.453119:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dd994 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.453126:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dd994 expref: 23 pid: 6515 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.453134:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796793088:0@lo:104: 00000100:00100000:2.0:1788509437.453151:0:13731:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9813e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788509437.453552:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788509437.453575:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509437.453604:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509437.453623:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509437.453634:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796792704 00000100:00100000:1.0:1788509437.453642:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796792704 00000100:00100000:1.0:1788509437.453691:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796792832 00000100:00100000:1.0:1788509437.453703:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796792832 00000100:00100000:1.0:1788509437.453718:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796792960 00000100:00100000:1.0:1788509437.453721:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796792960 00000100:00100000:1.0:1788509437.453733:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796793088 00000100:00100000:1.0:1788509437.453735:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796793088 00000100:00100000:1.0:1788509437.453760:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788509437.453770:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87741450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:13731:x1875387796792704:12345-0@lo:104: 00010000:00010000:1.0:1788509437.453785:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.453862:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509437.453869:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87741450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+6:13731:x1875387796792704:12345-0@lo:104: Request processed in 101us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509437.453876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788509437.453975:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788509437.453983:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:13731:x1875387796792832:12345-0@lo:104: 00010000:00010000:1.0:1788509437.453992:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454031:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788509437.454037:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+5:13731:x1875387796792832:12345-0@lo:104: Request processed in 55us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509437.454043:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788509437.454058:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788509437.454064:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:13731:x1875387796792960:12345-0@lo:104: 00010000:00010000:1.0:1788509437.454072:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454101:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788509437.454115:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+4:13731:x1875387796792960:12345-0@lo:104: Request processed in 52us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509437.454121:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788509437.454137:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788509437.454144:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:13731:x1875387796793088:12345-0@lo:104: 00010000:00010000:1.0:1788509437.454153:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454191:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788509437.454196:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+3:13731:x1875387796793088:12345-0@lo:104: Request processed in 54us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509437.454202:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788509437.454226:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788509437.454233:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454242:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509437.454247:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454258:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509437.454266:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509437.454274:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509437.454329:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454347:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509437.454372:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454381:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dd9be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454397:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788509437.454400:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454406:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509437.454409:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454416:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509437.454422:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509437.454428:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509437.454453:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454459:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509437.454476:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454484:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd80030600/0xe5156b86310dd9b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454501:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509437.454504:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454510:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8e00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509437.454513:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454519:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509437.454524:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509437.454529:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509437.454554:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454561:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509437.454568:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454575:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8e00/0xe5156b86310dd9a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd9a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454584:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509437.454587:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454604:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509437.454607:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454613:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509437.454619:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509437.454624:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509437.454647:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454653:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509437.454659:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454666:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a000/0xe5156b86310dd994 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dd99b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.454681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509437.454683:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509437.454686:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509437.454694:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509437.454708:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796793216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509437.454746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509437.454792:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509437.454792:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796793216 00000100:00100000:0.0:1788509437.454801:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796793216 00000100:00100000:1.0:1788509437.454802:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796793600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509437.454834:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd9be expref: 24 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509437.454842:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509437.454881:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796793600 00000100:00100000:0.0:1788509437.454885:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796793600 00000100:00100000:1.0:1788509437.454892:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796793344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509437.454927:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd994 expref: 25 pid: 6515 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509437.454943:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509437.454949:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796793344 00000100:00100000:0.0:1788509437.454954:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796793344 00000100:00100000:1.0:1788509437.454968:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788509437.454970:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 26 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509437.454977:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796793472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509437.454993:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788509437.455002:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+26:3645:x1875387796793216:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509437.455008:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509437.455020:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509437.455028:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd9be expref: 26 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509437.455039:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796793472 00010000:00010000:0.0:1788509437.455043:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd9be expref: 26 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509437.455045:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796793472 00010000:00010000:1.0:1788509437.455066:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 27 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.455067:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509437.455087:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788509437.455095:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+27:3645:x1875387796793600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509437.455104:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509437.455109:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd994 expref: 27 pid: 6515 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509437.455111:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+27:3645:x1875387796793216:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509437.455126:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:1.0:1788509437.455129:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd994 expref: 27 pid: 6515 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.455145:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509437.455154:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788509437.455173:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+26:3645:x1875387796793600:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509437.455176:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+26:3646:x1875387796793344:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509437.455186:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788509437.455189:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509437.455197:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 25 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509437.455205:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1788509437.455210:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 25 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509437.455215:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+25:3646:x1875387796793472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509437.455229:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509437.455230:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509437.455240:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 25 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.455250:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 25 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509437.455262:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509437.455267:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+25:3646:x1875387796793344:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509437.455275:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788509437.455293:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796793472:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509437.455300:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788509437.455344:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796793472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509437.455353:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796793344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509437.455379:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796793600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509437.455387:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796793216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509437.458600:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509437.458645:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774692224 00000100:00100000:3.0:1788509437.458658:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774692224 00000100:00100000:0.0:1788509437.458693:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788509437.458708:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 13 pid: 6515 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509437.458719:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774692352 00000100:00100000:0.0:1788509437.458724:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774692352 00010000:00010000:0.0:1788509437.458745:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 14 pid: 6514 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509437.458752:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788509437.459285:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+14:2408:x1875387774692224:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509437.459319:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509437.459326:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 14 pid: 6515 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509437.459342:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 14 pid: 6515 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509437.459369:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509437.459436:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+14:2408:x1875387774692224:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 157us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509437.460784:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788509437.460803:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+14:2408:x1875387774692352:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509437.460821:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509437.460830:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 14 pid: 6514 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460858:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 14 pid: 6514 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460914:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460925:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460944:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460952:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460959:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460966:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460973:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226200 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509437.460978:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460987:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.460996:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509437.461007:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509437.461058:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+14:2408:x1875387774692352:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 264us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509437.461074:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00010000:00010000:2.0:1788509437.464768:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9c00/0xe5156b86310dd9d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553009 expref: 13 pid: 6515 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.464796:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792448:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509437.464812:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dd9cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553002 expref: 12 pid: 6514 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.464822:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792576:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509437.464835:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226c00/0xe5156b86310dd9c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd9be expref: 23 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.464853:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792704:0@lo:104: 00010000:00010000:2.0:1788509437.464865:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310dd9b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd9b0 expref: 22 pid: 6514 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.464921:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792832:0@lo:104: 00010000:00010000:2.0:1788509437.464937:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd80030800/0xe5156b86310dd9a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd9a2 expref: 21 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.465297:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796792960:0@lo:104: 00010000:00010000:2.0:1788509437.465314:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd80030000/0xe5156b86310dd99b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dd994 expref: 20 pid: 6515 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509437.465322:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1875387796793088:0@lo:104: 00010000:00010000:2.0:1788509437.465364:0:13731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.465377:0:13731:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.465384:0:13731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509437.465391:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226200/0xe5156b86310ddb0e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509437.492205:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00010000:00010000:1.0:1788509437.846515:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788509438.535697:0:13780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc86acd230 20000000:00000080:2.0:1788509438.535721:0:13780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bcc87787000 uarg=0000000000000000 20000000:01000000:2.0:1788509438.535775:0:13780:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788509438.535783:0:13780:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788509438.535788:0:13780:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788509438.539390:0:13781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788509438.539634:0:13780:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788509438.539770:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788509438.539810:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788509438.539828:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788509438.539853:0:13780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788509438.539893:0:13780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540331:0:13780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540344:0:13780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540374:0:13780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540383:0:13780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540391:0:13780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540399:0:13780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9e00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509438.540404:0:13780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540414:0:13780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540430:0:13780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540438:0:13780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.540445:0:13780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb15 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509438.870053:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788509439.254144:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509439.254158:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdb59c5000 from 7 10000000:01000000:0.0:1788509439.254163:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509439.254243:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509439.254255:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509439.254267:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509439.254309:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796793728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509439.254429:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509439.254505:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8109af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509439.254535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796793728 00000100:00100000:2.0:1788509439.254556:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796793728 00000100:00100000:2.0:1788509439.254623:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788509439.254633:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:6517:x1875387796793728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509439.254646:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509439.254659:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227000/0xe5156b86310ddb23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310ddb1c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.254684:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227000/0xe5156b86310ddb23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310ddb1c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.254695:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227000/0xe5156b86310ddb23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310ddb1c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.254704:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227000, rc 0) 00000100:00100000:2.0:1788509439.254749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796793728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509439.254756:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788509439.255076:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796793728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509439.255091:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.255112:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509439.255170:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796793856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.255205:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.255303:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd81254600 going to sleep for 11 seconds 00000100:00100000:2.0:1788509439.255374:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796793856 00000100:00100000:2.0:1788509439.255379:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796793856 00000100:00100000:2.0:1788509439.255452:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788509439.255461:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796793856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509439.255601:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796793856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509439.255608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788509439.255668:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796793856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.255695:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796793984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.255734:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.255806:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd81254600 going to sleep for 11 seconds 00000100:00100000:3.0:1788509439.255845:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796793984 00000100:00100000:3.0:1788509439.255849:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796793984 00000100:00100000:3.0:1788509439.255873:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788509439.255880:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796793984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509439.256071:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796793984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509439.256078:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788509439.257981:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796793984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.260101:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13793:1875387796794112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.260188:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.260280:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd81254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509439.261177:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796794112 00000100:00100000:3.0:1788509439.261186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796794112 00000100:00100000:3.0:1788509439.261281:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788509439.261292:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:13793:x1875387796794112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509439.261447:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:13793:x1875387796794112:12345-0@lo:502:llog_process_th.0 Request processed in 157us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509439.261455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788509439.261542:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13793:1875387796794112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509439.261571:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509439.261582:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.261585:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509439.261592:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcdb59c5000 00000020:00000080:1.0:1788509439.261595:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509439.261667:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509439.261671:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.261672:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509439.261674:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509439.261677:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.261684:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788509439.261689:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcdb59c5000 00000020:00000080:1.0:1788509439.261691:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788509439.261730:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13793:1875387796794240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.261770:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509439.266917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796794240 00000100:00100000:0.0:1788509439.266929:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796794240 00000100:00100000:0.0:1788509439.266979:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788509439.266989:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:13793:x1875387796794240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509439.267153:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:13793:x1875387796794240:12345-0@lo:502:llog_process_th.0 Request processed in 166us (5382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509439.267161:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788509439.267247:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd81254cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509439.267270:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13793:1875387796794240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509439.267302:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509439.267311:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509439.267320:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788509439.267325:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788509439.267394:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788509439.267427:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509439.267438:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509439.267449:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509439.267460:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509439.267462:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd913e8000 from 7 10000000:01000000:0.0:1788509439.267465:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509439.267494:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509439.267502:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509439.267511:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509439.267529:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796794368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509439.267566:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509439.267587:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8109a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.267659:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796794368 00000100:00100000:1.0:1788509439.267665:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796794368 00000100:00100000:1.0:1788509439.267689:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788509439.267697:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:6517:x1875387796794368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509439.267706:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509439.267720:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310ddb31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310ddb2a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.267740:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310ddb31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310ddb2a expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.267752:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310ddb31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310ddb2a expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.267761:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8000, rc 0) 00000100:00100000:1.0:1788509439.267798:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796794368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.267804:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788509439.267861:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796794368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509439.267872:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.267881:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509439.267953:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796794496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.267979:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.267994:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd81254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.268006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796794496 00000100:00100000:1.0:1788509439.268009:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796794496 00000100:00100000:1.0:1788509439.268024:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788509439.268030:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796794496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.268115:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796794496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.268122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788509439.268150:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796794496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.268175:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796794624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.268205:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.268218:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb446b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.268227:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796794624 00000100:00100000:1.0:1788509439.268230:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796794624 00000100:00100000:1.0:1788509439.268245:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788509439.268250:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796794624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.268324:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796794624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.268331:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788509439.268367:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796794624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.268790:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13796:1875387796794752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.269043:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.269067:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796794752 00000100:00100000:1.0:1788509439.269071:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796794752 00000100:00100000:1.0:1788509439.269089:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788509439.269095:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:13796:x1875387796794752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.269164:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:13796:x1875387796794752:12345-0@lo:502:llog_process_th.0 Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.269170:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788509439.269208:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd81254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.269219:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13796:1875387796794752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509439.269239:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509439.269247:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.269250:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509439.269256:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcd913e8000 00000020:00000080:1.0:1788509439.269259:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509439.269433:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509439.269437:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.269439:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509439.269442:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509439.269445:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.269446:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788509439.269449:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcd913e8000 00000020:00000080:1.0:1788509439.269594:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788509439.269636:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13796:1875387796794880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.269772:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.269798:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796794880 00000100:00100000:1.0:1788509439.269803:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796794880 00000100:00100000:1.0:1788509439.269829:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788509439.269853:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:13796:x1875387796794880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.269938:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:13796:x1875387796794880:12345-0@lo:502:llog_process_th.0 Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.269945:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788509439.269981:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828eae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.269994:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13796:1875387796794880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509439.270011:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509439.270015:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.270017:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788509439.270020:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788509439.270075:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788509439.270095:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788509439.270102:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.270112:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509439.270122:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788509439.270124:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcdbbf0f800 from 7 10000000:01000000:1.0:1788509439.270127:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788509439.270148:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.270156:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.270165:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509439.270187:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.270212:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.270226:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828eae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.270238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796795008 00000100:00100000:1.0:1788509439.270241:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796795008 00000100:00100000:1.0:1788509439.270259:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788509439.270264:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:6517:x1875387796795008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509439.270272:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509439.270950:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310ddb38 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.270974:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310ddb38 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.270985:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310ddb38 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.270995:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9e00, rc 0) 00000100:00100000:1.0:1788509439.271037:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796795008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 771us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.271043:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788509439.271088:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509439.271102:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.271111:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509439.271166:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.271192:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.271206:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828eae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.271220:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796795136 00000100:00100000:1.0:1788509439.271223:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796795136 00000100:00100000:1.0:1788509439.271244:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788509439.271250:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796795136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.271648:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796795136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.271655:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788509439.271689:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.271716:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.271750:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.271765:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828eae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.271776:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796795264 00000100:00100000:1.0:1788509439.271779:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796795264 00000100:00100000:1.0:1788509439.271797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788509439.271802:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796795264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.272005:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796795264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.272011:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788509439.272051:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.272265:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13797:1875387796795392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.272625:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.272858:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509439.272934:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796795392 00000100:00100000:3.0:1788509439.272940:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796795392 00000100:00100000:3.0:1788509439.272974:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788509439.272980:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:13797:x1875387796795392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509439.273072:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:13797:x1875387796795392:12345-0@lo:502:llog_process_th.0 Request processed in 91us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509439.273079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788509439.273391:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13797:1875387796795392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509439.273417:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509439.273426:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.273429:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509439.273437:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcdbbf0f800 00000020:00000080:1.0:1788509439.273439:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509439.273642:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509439.273646:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.273648:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509439.273651:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509439.273653:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.273655:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788509439.273659:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcdbbf0f800 00000020:00000080:1.0:1788509439.273661:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788509439.273697:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13797:1875387796795520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.273738:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.273761:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509439.273934:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796795520 00000100:00100000:3.0:1788509439.273941:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796795520 00000100:00100000:3.0:1788509439.273974:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788509439.273982:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:13797:x1875387796795520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509439.274156:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:13797:x1875387796795520:12345-0@lo:502:llog_process_th.0 Request processed in 173us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509439.274163:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788509439.274385:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13797:1875387796795520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509439.274405:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509439.274410:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.274412:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788509439.274415:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788509439.274721:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788509439.274742:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788509439.274751:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509439.274866:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509439.274880:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788509439.274882:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd82e88800 from 7 10000000:01000000:3.0:1788509439.274885:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788509439.274981:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509439.274989:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509439.275011:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509439.275028:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788509439.275064:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509439.275220:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.275266:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796795648 00000100:00100000:1.0:1788509439.275611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796795648 00000100:00100000:1.0:1788509439.275662:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788509439.275671:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:6517:x1875387796795648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509439.275693:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509439.275706:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310ddb4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310ddb46 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.275730:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310ddb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310ddb46 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.275740:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310ddb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310ddb46 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509439.275749:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9800, rc 0) 00000100:00100000:1.0:1788509439.275809:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796795648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.275816:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788509439.275883:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509439.275913:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509439.275925:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509439.275996:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509439.276025:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509439.276054:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.276163:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796795776 00000100:00100000:1.0:1788509439.276169:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796795776 00000100:00100000:1.0:1788509439.276200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788509439.276207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796795776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.276299:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796795776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.276305:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788509439.276634:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509439.276664:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509439.276716:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509439.276735:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.276817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796795904 00000100:00100000:1.0:1788509439.276822:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796795904 00000100:00100000:1.0:1788509439.276864:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788509439.276871:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796795904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509439.277221:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:6517:x1875387796795904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 350us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.277238:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788509439.277317:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:6517:1875387796795904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509439.278465:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13798:1875387796796032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509439.278517:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509439.278556:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509439.278845:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796796032 00000100:00100000:0.0:1788509439.278851:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796796032 00000100:00100000:0.0:1788509439.278892:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788509439.278922:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:13798:x1875387796796032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509439.279020:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:13798:x1875387796796032:12345-0@lo:502:llog_process_th.0 Request processed in 120us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509439.279032:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788509439.279127:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13798:1875387796796032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509439.279153:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509439.279162:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.279164:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509439.279171:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcd82e88800 00000020:00000080:1.0:1788509439.279174:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509439.279220:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509439.279223:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.279224:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509439.279227:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509439.279229:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.279230:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788509439.279234:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcd82e88800 00000020:00000080:1.0:1788509439.279236:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788509439.279266:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13798:1875387796796160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.279299:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509439.279322:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd923f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509439.279335:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796796160 00000100:00100000:1.0:1788509439.279339:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796796160 00000100:00100000:1.0:1788509439.279360:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788509439.279366:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:13798:x1875387796796160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509439.279428:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:13798:x1875387796796160:12345-0@lo:502:llog_process_th.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509439.279434:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788509439.279478:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:13798:1875387796796160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788509439.279495:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509439.279502:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509439.279504:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788509439.279507:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788509439.279646:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788509439.279668:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509439.279677:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509439.279688:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788509439.281659:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788509439.297141:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788509439.380084:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509439.380312:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774692480 00000100:00100000:2.0:1788509439.380323:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774692480 00000100:00100000:2.0:1788509439.380788:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 356 00000100:00100000:2.0:1788509439.380801:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:6182:x1875387774692480:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509439.380842:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509439.380862:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310ddb54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647553056 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.380890:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310ddb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553056 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.380935:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310ddb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553056 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.380945:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227a00, rc 0) 00000100:00100000:2.0:1788509439.381015:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774692480:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 209us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509439.381024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 356 00000100:00100000:0.0:1788509439.383634:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509439.383820:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774692608 00000100:00100000:3.0:1788509439.383843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774692608 00000100:00100000:3.0:1788509439.384733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 357 00000100:00100000:3.0:1788509439.384755:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774692608:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509439.385030:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774692608:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 284us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509439.385039:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 357 00000100:00100000:1.0:1788509439.404741:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509439.404879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774692736 00000100:00100000:0.0:1788509439.404892:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774692736 00000100:00100000:0.0:1788509439.404989:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 358 00000100:00100000:0.0:1788509439.405003:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774692736:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509439.405323:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774692736:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 323us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509439.405332:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 358 00000100:00100000:1.0:1788509439.430889:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509439.432139:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774692864 00000100:00100000:3.0:1788509439.432322:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774692864 00000100:00100000:3.0:1788509439.432585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 359 00000100:00100000:3.0:1788509439.432600:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:10788:x1875387774692864:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788509439.432812:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:10788:x1875387774692864:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 215us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509439.432821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 359 00000100:00100000:2.0:1788509439.443715:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509439.443952:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774692992 00000100:00100000:1.0:1788509439.443967:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774692992 00000100:00100000:0.0:1788509439.445413:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 360 00000100:00100000:0.0:1788509439.445443:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:10788:x1875387774692992:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788509439.445648:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:10788:x1875387774692992:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 219us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509439.445656:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 360 00000100:00100000:1.0:1788509439.460324:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509439.473408:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774693120 00000100:00100000:2.0:1788509439.473432:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774693120 00000100:00100000:2.0:1788509439.473778:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 361 00000100:00100000:2.0:1788509439.473790:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:6182:x1875387774693120:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509439.473812:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509439.473845:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310ddb5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e464755305d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.473881:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310ddb5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755305d expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.473895:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310ddb5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755305d expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509439.473947:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227e00, rc 0) 00000100:00100000:2.0:1788509439.474031:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774693120:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 243us (13720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509439.474038:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 361 00000100:00100000:1.0:1788509439.479489:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509439.479695:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774693248 00000100:00100000:0.0:1788509439.479709:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774693248 00000100:00100000:0.0:1788509439.479784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 362 00000100:00100000:0.0:1788509439.479797:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774693248:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509439.480070:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774693248:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 275us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509439.480079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 362 00000100:00100000:0.0:1788509439.490797:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509439.490976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774693376 00000100:00100000:3.0:1788509439.490989:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774693376 00000100:00100000:3.0:1788509439.491061:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 363 00000100:00100000:3.0:1788509439.491074:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774693376:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509439.491440:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:6182:x1875387774693376:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 367us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509439.491449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 363 00000100:00100000:1.0:1788509439.495134:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509439.496953:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774693504 00000100:00100000:2.0:1788509439.496975:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774693504 00000100:00100000:2.0:1788509439.497104:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 364 00000100:00100000:2.0:1788509439.497117:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:10792:x1875387774693504:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788509439.497355:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:10792:x1875387774693504:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 239us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509439.497364:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 364 00000100:00100000:1.0:1788509439.500938:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509439.512353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774693632 00000100:00100000:0.0:1788509439.512381:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774693632 00000100:00100000:0.0:1788509439.512454:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 365 00000100:00100000:0.0:1788509439.512854:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:10792:x1875387774693632:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788509439.513100:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:10792:x1875387774693632:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 635us (12218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509439.513110:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 365 00010000:00010000:1.0:1788509439.894190:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509440.342713:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788509440.343402:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788509440.726314:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509440.726346:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796796288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509440.726639:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509440.727703:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796796288 00000100:00100000:3.0:1788509440.727719:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796796288 00000100:00100000:3.0:1788509440.727812:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788509440.727833:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796796288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509440.727882:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509440.728032:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796796288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 209us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509440.728042:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788509440.728104:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796796288:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509440.918324:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509441.238202:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796796544:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.238274:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.238330:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796797056:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.238359:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.238379:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796797568:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.238402:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.238419:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796798080:0@lo:400:kworker.0 00000100:00100000:3.0:1788509441.238445:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796796416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509441.238446:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509441.238486:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509441.238510:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796796928:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.238527:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796796800:0@lo:400:kworker.0 00000100:00100000:3.0:1788509441.238535:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509441.238555:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796797440:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.238561:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509441.238588:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.238588:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796797312:0@lo:400:kworker.0 00000100:00100000:2.0:1788509441.238707:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796796928 00000100:00100000:2.0:1788509441.238714:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796796928 00000100:00100000:2.0:1788509441.238756:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788509441.238764:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796796928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509441.239011:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796796544 00000100:00100000:1.0:1788509441.239026:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796796544 00000100:00100000:1.0:1788509441.239089:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788509441.239099:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796796544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.241992:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.242052:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796797824:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.242091:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.242848:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788509441.242859:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796796672:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.242916:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.242934:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796797184:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.242978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.242994:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796797696:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.243017:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.243029:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796798208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509441.243052:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509441.243101:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796796416 00000100:00100000:0.0:1788509441.243791:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796796416 00000100:00100000:0.0:1788509441.244550:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788509441.244571:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796796416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788509441.244605:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509441.244760:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796796416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 196us (6273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.244768:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788509441.244803:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796797312 00000100:00100000:0.0:1788509441.244809:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796797312 00000100:00100000:0.0:1788509441.244845:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796797824 00000100:00100000:0.0:1788509441.244860:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796797824 00000100:00100000:0.0:1788509441.244879:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796796672 00000100:00100000:0.0:1788509441.244882:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796796672 00000100:00100000:0.0:1788509441.244895:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796797184 00000100:00100000:0.0:1788509441.244914:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796797184 00000100:00100000:0.0:1788509441.244929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796797696 00000100:00100000:0.0:1788509441.244932:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796797696 00000100:00100000:0.0:1788509441.244946:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788509441.244952:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796797312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.244995:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796797312:12345-0@lo:400:kworker.0 Request processed in 43us (3010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.245002:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788509441.245016:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788509441.245022:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796797824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245050:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796797824:12345-0@lo:400:kworker.0 Request processed in 29us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.245056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788509441.245068:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788509441.245073:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796796672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245100:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796796672:12345-0@lo:400:kworker.0 Request processed in 27us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.245106:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788509441.245331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788509441.245338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796797184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245371:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796797184:12345-0@lo:400:kworker.0 Request processed in 33us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.245377:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788509441.245396:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788509441.245402:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796797696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245432:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796797696:12345-0@lo:400:kworker.0 Request processed in 30us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.245438:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788509441.245463:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796797056 00000100:00100000:0.0:1788509441.245467:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796797056 00000100:00100000:0.0:1788509441.245486:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796796800 00000100:00100000:0.0:1788509441.245489:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796796800 00000100:00100000:0.0:1788509441.245499:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796798208 00000100:00100000:0.0:1788509441.245501:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796798208 00000100:00100000:0.0:1788509441.245511:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788509441.245516:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796797056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245555:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796797056:12345-0@lo:400:kworker.0 Request processed in 38us (7194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.245561:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788509441.245571:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788509441.245577:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875387796796800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245605:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875387796796800:12345-0@lo:400:kworker.0 Request processed in 28us (7045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.245610:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788509441.245620:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788509441.245774:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796798208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509441.245799:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788509441.245841:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796798208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.245847:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788509441.245922:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796797056:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245965:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796796672:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245977:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796797184:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.245987:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796797696:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.246001:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796798208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509441.246011:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796796800:0@lo:400:kworker.0 00010000:00080000:0.0:1788509441.246023:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7872680 x1875387796797312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509441.246033:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796797312:0@lo:400:kworker.0 00010000:00080000:0.0:1788509441.246043:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876aea00 x1875387796797824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509441.246051:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796797824:0@lo:400:kworker.0 00000100:00080000:0.0:1788509441.247370:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509441.247379:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509441.247382:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509441.247457:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796797568 00000100:00100000:0.0:1788509441.247465:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796797568 00000100:00100000:0.0:1788509441.247512:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796798080 00000100:00100000:0.0:1788509441.247516:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796798080 00000100:00100000:0.0:1788509441.247533:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796797440 00000100:00100000:0.0:1788509441.247536:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796797440 00000100:00100000:0.0:1788509441.247553:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788509441.247562:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796797568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.247853:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796797568:12345-0@lo:400:kworker.0 Request processed in 293us (9448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509441.247873:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788509441.247886:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788509441.247914:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796798080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509441.247962:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796798080:12345-0@lo:400:kworker.0 Request processed in 65us (9518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509441.247970:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788509441.247992:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788509441.248001:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796797440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509441.248044:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796797440:12345-0@lo:400:kworker.0 Request processed in 46us (9458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509441.248058:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788509441.248100:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796796928:12345-0@lo:400:kworker.0 Request processed in 9335us (9563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509441.248107:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:0.0:1788509441.248258:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509441.248262:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509441.251160:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796797440:0@lo:400:kworker.0 00000100:00100000:3.0:1788509441.251177:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796797952:0@lo:400:kworker.0 00000100:00100000:3.0:1788509441.251240:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509441.251292:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796797952 00000100:00100000:3.0:1788509441.251298:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796797952 00000100:00100000:3.0:1788509441.251428:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788509441.251437:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796797952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509441.251486:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796797952:12345-0@lo:400:kworker.0 Request processed in 50us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509441.251492:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1788509441.251527:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876aed80 x1875387796797952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509441.251538:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796797952:0@lo:400:kworker.0 00010000:00080000:3.0:1788509441.251567:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3dc00 x1875387796796416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509441.251583:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796796416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509441.251612:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796796928:0@lo:400:kworker.0 00000100:00100000:2.0:1788509441.256510:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796797568:0@lo:400:kworker.0 00010000:00080000:2.0:1788509441.256623:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876ac380 x1875387796798080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509441.256635:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796798080:0@lo:400:kworker.0 00000100:00100000:2.0:1788509441.256671:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796798336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509441.256732:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509441.256806:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796798336 00000100:00100000:2.0:1788509441.256813:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796798336 00000100:00100000:2.0:1788509441.256868:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788509441.256876:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796798336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788509441.256915:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509441.257380:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796798336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 502us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509441.257388:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1788509441.257429:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd812ab100 x1875387796798336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509441.257447:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796798336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509441.269038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796796544:12345-0@lo:400:kworker.0 Request processed in 29925us (30749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509441.269057:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788509441.269092:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796796544:0@lo:400:kworker.0 00000100:00100000:0.0:1788509441.751142:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509441.751176:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796798464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509441.751266:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509441.756070:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796798592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788509441.756173:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509441.758348:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796798464 00000100:00100000:2.0:1788509441.758368:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796798464 00000100:00100000:2.0:1788509441.758441:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796798592 00000100:00100000:2.0:1788509441.758459:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796798592 00000100:00100000:2.0:1788509441.758478:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788509441.758489:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796798464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788509441.758530:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509441.759158:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788509441.759170:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796798592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509441.759183:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509441.762486:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796798464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3985us (11206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509441.762508:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788509441.762772:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796798592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3603us (6596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509441.762780:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788509441.763571:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796798592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788509441.763598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796798464:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788509441.943086:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509442.326697:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509442.326828:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509442.326857:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509442.326888:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509442.326970:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774694016 00000100:00100000:1.0:1788509442.326973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509442.326984:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774694016 00000100:00100000:1.0:1788509442.327020:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509442.327044:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774694272 00000100:00100000:1.0:1788509442.327049:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774694272 00000100:00100000:0.0:1788509442.327069:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774693888 00000100:00100000:0.0:1788509442.327074:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774693888 00000100:00100000:1.0:1788509442.327078:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774694400 00000100:00100000:1.0:1788509442.327083:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774694400 00000100:00100000:0.0:1788509442.327109:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:0.0:1788509442.327124:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509442.327174:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774694144 00000100:00100000:2.0:1788509442.327181:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774694144 00000100:00100000:0.0:1788509442.327235:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 113us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509442.327355:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788509442.327365:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509442.327399:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509442.327406:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:1.0:1788509442.327837:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:1.0:1788509442.327850:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774694272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509442.327883:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774694272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509442.327891:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:1.0:1788509442.328532:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:1.0:1788509442.328545:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774693888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509442.328583:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774693888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509442.328588:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:1.0:1788509442.328603:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:1.0:1788509442.328609:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774694400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509442.328636:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774694400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509442.328642:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00080000:1.0:1788509442.328881:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509442.328943:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509442.328945:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509442.330494:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774693760 00000100:00100000:3.0:1788509442.330510:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774693760 00000100:00100000:3.0:1788509442.330593:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 367 00000100:00100000:3.0:1788509442.330604:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774693760:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509442.330678:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774693760:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (3996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509442.330686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 367 00000100:00100000:0.0:1788509442.333955:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000001:00080000:2.0:1788509442.783113:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1788509442.966055:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509443.990318:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509445.014050:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509445.846159:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796798720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509445.846233:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509445.846311:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796798720 00000100:00100000:1.0:1788509445.846320:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796798720 00000100:00100000:1.0:1788509445.846376:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788509445.846386:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796798720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509445.846420:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509445.862499:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796798720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 16105us (16258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509445.862513:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788509445.865552:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796798720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509446.038852:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509446.358134:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796798976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509446.358197:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796798848:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.358206:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509446.358244:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509446.358274:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796799488:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.358277:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796799360:0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.358312:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509446.358325:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796798976 00000100:00100000:2.0:1788509446.358332:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796798976 00000100:00100000:0.0:1788509446.358336:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796800000:0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.358380:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509446.358384:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788509446.358397:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796798976:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509446.358403:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796800512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509446.358414:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796799232:0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.358430:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1788509446.358433:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788509446.358439:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509446.358449:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788509446.358453:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796799744:0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.358454:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796799104:0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.358474:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509446.358477:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509446.358493:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796800256:0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.358493:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796799616:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.358502:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796798976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509446.358511:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788509446.358520:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509446.358527:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509446.358541:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796799232 00000100:00100000:0.0:1788509446.358541:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796800128:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.358548:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796799232 00000100:00100000:3.0:1788509446.358559:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796799744 00000100:00100000:3.0:1788509446.358564:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796799744 00000100:00100000:0.0:1788509446.358570:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509446.358584:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788509446.358585:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796800640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509446.358596:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796799232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509446.358602:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796800256 00000100:00100000:3.0:1788509446.358606:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796800256 00000100:00100000:0.0:1788509446.358607:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509446.358630:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788509446.358632:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796800512 00000100:00100000:0.0:1788509446.358636:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796800512 00000100:00100000:3.0:1788509446.358644:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796799744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.358651:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796799232:12345-0@lo:400:kworker.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509446.358660:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788509446.358664:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796800640 00000100:00100000:0.0:1788509446.358668:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796800640 00000100:00100000:3.0:1788509446.358683:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796799744:12345-0@lo:400:kworker.0 Request processed in 40us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509446.358685:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788509446.358687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796799488 00000100:00100000:3.0:1788509446.358691:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788509446.358692:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796800512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509446.358693:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796799488 00000100:00100000:3.0:1788509446.358706:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788509446.358715:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796800256:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788509446.358716:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509446.358725:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796800000 00000100:00100000:2.0:1788509446.358731:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796800000 00000100:00100000:2.0:1788509446.358748:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796799104 00000100:00100000:3.0:1788509446.358757:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796800256:12345-0@lo:400:kworker.0 Request processed in 44us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509446.358763:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788509446.358796:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788509446.358805:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796800640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509446.358815:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509446.358815:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796799616 00000100:00100000:1.0:1788509446.358821:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796799616 00000100:00100000:0.0:1788509446.358843:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796800512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509446.358849:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796799104 00000100:00100000:0.0:1788509446.358864:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788509446.358868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796800128 00000100:00100000:2.0:1788509446.358872:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796800128 00000100:00100000:2.0:1788509446.358893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788509446.358895:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509446.358923:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796799488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.358937:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796799872:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.358965:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796799488:12345-0@lo:400:kworker.0 Request processed in 44us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509446.358973:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509446.358975:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788509446.358989:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796799360 00000100:00100000:2.0:1788509446.358993:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796799360 00000100:00100000:0.0:1788509446.358996:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796800384:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359012:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788509446.359021:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796800000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.359033:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509446.359061:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796800000:12345-0@lo:400:kworker.0 Request processed in 41us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509446.359068:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788509446.359077:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796798976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509446.359083:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788509446.359090:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796799104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359126:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796799104:12345-0@lo:400:kworker.0 Request processed in 37us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509446.359132:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788509446.359144:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788509446.359149:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796800128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359173:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796800128:12345-0@lo:400:kworker.0 Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509446.359178:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788509446.359188:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788509446.359193:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796799360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359222:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796799360:12345-0@lo:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509446.359228:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788509446.359242:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796799360:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359249:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796799872 00000100:00100000:2.0:1788509446.359254:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796799872 00000100:00100000:0.0:1788509446.359277:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796799104:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359278:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796800384 00000100:00100000:2.0:1788509446.359283:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796800384 00010000:00080000:0.0:1788509446.359294:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd812a9f80 x1875387796800128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509446.359300:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788509446.359310:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796799872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.359312:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796800128:0@lo:400:kworker.0 00010000:00080000:0.0:1788509446.359327:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc811cc700 x1875387796800512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509446.359341:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796800512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509446.359355:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796799488:0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.359367:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796800000:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359374:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796799872:12345-0@lo:400:kworker.0 Request processed in 62us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509446.359383:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788509446.359399:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788509446.359405:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796800384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.359415:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796798848 00000100:00100000:0.0:1788509446.359420:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796798848 00000100:00100000:2.0:1788509446.359440:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796800384:12345-0@lo:400:kworker.0 Request processed in 34us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509446.359455:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788509446.359463:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788509446.359467:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796798848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359507:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00100000:0.0:1788509446.359509:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796798848:12345-0@lo:400:kworker.0 Request processed in 45us (1266us total) trans 0 rc 0/0 00000004:00080000:2.0:1788509446.359515:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcc87356d80, transno 4294967301 00000100:00100000:0.0:1788509446.359521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788509446.359532:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796799872:0@lo:400:kworker.0 00010000:00080000:2.0:1788509446.359548:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd812ab480 x1875387796800384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509446.359558:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796800384:0@lo:400:kworker.0 00000100:00100000:0.0:1788509446.359565:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796798848:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796799232:0@lo:400:kworker.0 00000100:00100000:2.0:1788509446.359603:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796799744:0@lo:400:kworker.0 00010000:00080000:2.0:1788509446.359612:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd812aaa00 x1875387796800256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509446.359620:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796800256:0@lo:400:kworker.0 00000100:00080000:0.0:1788509446.359692:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509446.359697:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509446.359706:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509446.359709:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509446.360000:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788509446.360010:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796799616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509446.360062:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796799616:12345-0@lo:400:kworker.0 Request processed in 55us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509446.360069:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00010000:00080000:2.0:1788509446.360144:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd812a9180 x1875387796799616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509446.360203:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796800640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1398us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509446.360211:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788509446.360282:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796799616:0@lo:400:kworker.0 00010000:00080000:2.0:1788509446.360298:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc811cea00 x1875387796800640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509446.360311:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796800640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509446.870310:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796800768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509446.870397:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509446.870845:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796800768 00000100:00100000:1.0:1788509446.870854:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796800768 00000100:00100000:1.0:1788509446.870937:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788509446.870947:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796800768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788509446.870990:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509446.871052:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796800768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509446.871073:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788509446.871132:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796800768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509446.871520:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796800896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509446.871561:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509446.871743:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796800896 00000100:00100000:0.0:1788509446.871749:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796800896 00000100:00100000:0.0:1788509446.871794:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788509446.871802:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796800896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509446.871816:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509446.871857:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796800896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509446.871863:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788509446.871983:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796800896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788509447.062051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509447.448197:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509447.448246:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509447.448278:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509447.448297:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509447.448317:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509447.448340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509447.448485:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774694912 00000100:00100000:2.0:1788509447.448506:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774694912 00000100:00100000:2.0:1788509447.448576:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1788509447.448586:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509447.448657:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509447.448663:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1788509447.448765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774694784 00000100:00100000:2.0:1788509447.448769:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774694784 00000100:00100000:2.0:1788509447.448800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774695040 00000100:00100000:2.0:1788509447.448802:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774695040 00000100:00100000:2.0:1788509447.448814:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774694656 00000100:00100000:2.0:1788509447.448816:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774694656 00000100:00100000:2.0:1788509447.448828:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774695168 00000100:00100000:2.0:1788509447.448830:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774695168 00000100:00100000:2.0:1788509447.448843:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:2.0:1788509447.448850:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509447.448883:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509447.448889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:2.0:1788509447.448938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:2.0:1788509447.448945:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774695040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509447.448970:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774695040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509447.448976:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:2.0:1788509447.448987:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:2.0:1788509447.448993:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509447.449027:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774694656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509447.449033:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:2.0:1788509447.449044:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:2.0:1788509447.449051:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774695168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509447.449074:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774695168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509447.449080:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00080000:3.0:1788509447.449339:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509447.449350:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509447.449353:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509447.449424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774694528 00000100:00100000:1.0:1788509447.449429:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774694528 00000100:00100000:0.0:1788509447.451670:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 369 00000100:00100000:0.0:1788509447.451695:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774694528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509447.451766:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774694528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (3578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509447.451773:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 369 00010000:00010000:1.0:1788509448.086151:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509449.111392:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509450.134121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509450.582700:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788509450.583698:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788509450.966603:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796801024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509450.966676:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509450.966826:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796801024 00000100:00100000:3.0:1788509450.966836:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796801024 00000100:00100000:3.0:1788509450.966886:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788509450.966895:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796801024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509450.967052:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509450.967127:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796801024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 232us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509450.967135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788509450.967718:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796801024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788509451.158156:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509451.478363:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796801152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509451.478494:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509451.478680:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796801152 00000100:00100000:3.0:1788509451.478688:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796801152 00000100:00100000:3.0:1788509451.478783:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788509451.478795:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796801152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509451.478823:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509451.478880:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796801152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509451.478888:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1788509451.478972:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc865dd180 x1875387796801152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509451.478992:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796801152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509451.479457:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509451.479467:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796801280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509451.479502:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788509451.479677:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509451.480690:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796801280 00000100:00100000:1.0:1788509451.480700:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796801280 00000100:00100000:1.0:1788509451.480772:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788509451.480782:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796801280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509451.480801:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509451.480869:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796801280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509451.480876:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788509451.481020:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796801664:0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.481342:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796801536:0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.481399:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509451.481449:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796802048:0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.481475:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509451.481494:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796802560:0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.481517:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509451.481549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796801536 00000100:00100000:0.0:1788509451.481554:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796801536 00000100:00100000:0.0:1788509451.481585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788509451.481592:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796801536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.481631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796801536:12345-0@lo:400:kworker.0 Request processed in 39us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509451.481650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788509451.481682:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796802048 00000100:00100000:0.0:1788509451.481686:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796802048 00000100:00100000:0.0:1788509451.481711:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796802560 00000100:00100000:0.0:1788509451.481714:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796802560 00000100:00100000:0.0:1788509451.481734:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788509451.481741:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796802048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.481787:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796802048:12345-0@lo:400:kworker.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509451.481794:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788509451.481806:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788509451.481813:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796802560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.481839:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796802560:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509451.481846:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788509451.481876:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796801792:0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.481967:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788509451.481986:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509451.481990:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796802304:0@lo:400:kworker.0 00000100:00080000:2.0:1788509451.481993:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509451.482017:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509451.482028:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796801792 00000100:00100000:2.0:1788509451.482033:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796801792 00000100:00100000:0.0:1788509451.482054:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788509451.482061:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796801408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509451.482079:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788509451.482085:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509451.482091:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796801792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.482107:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796801920:0@lo:400:kworker.0 00000100:00100000:2.0:1788509451.482142:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796801792:12345-0@lo:400:kworker.0 Request processed in 52us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509451.482142:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509451.482152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788509451.482165:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796802432:0@lo:400:kworker.0 00000100:00100000:2.0:1788509451.482167:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796801408 00000100:00100000:2.0:1788509451.482179:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796801408 00000100:00100000:2.0:1788509451.482201:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788509451.482205:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509451.482224:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796801408:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509451.482242:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796801792:0@lo:400:kworker.0 00000004:00000024:2.0:1788509451.482249:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788509451.482267:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796801920 00000100:00100000:0.0:1788509451.482272:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796801920 00000100:00100000:2.0:1788509451.482294:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796801408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509451.482299:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788509451.482306:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788509451.482311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796801920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509451.482330:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796802304 00000100:00100000:2.0:1788509451.482335:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796802304 00000100:00100000:0.0:1788509451.482351:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796801920:12345-0@lo:400:kworker.0 Request processed in 42us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509451.482358:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788509451.482368:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796802432 00000100:00100000:2.0:1788509451.482372:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796802432 00000100:00100000:0.0:1788509451.482396:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796801536:0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.482410:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796802048:0@lo:400:kworker.0 00000100:00100000:2.0:1788509451.482411:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788509451.482424:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796802304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.482426:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796802560:0@lo:400:kworker.0 00000100:00100000:0.0:1788509451.482465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796801408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509451.482468:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796802304:12345-0@lo:400:kworker.0 Request processed in 45us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509451.482477:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788509451.482483:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796801920:0@lo:400:kworker.0 00000100:00100000:2.0:1788509451.482495:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788509451.482499:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796802304:0@lo:400:kworker.0 00000100:00100000:2.0:1788509451.482506:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796802432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509451.482546:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796802432:12345-0@lo:400:kworker.0 Request processed in 44us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509451.482554:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788509451.482561:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796802432:0@lo:400:kworker.0 00000100:00080000:2.0:1788509451.482579:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788509451.482920:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc865dd880 x1875387796801280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509451.482940:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796801280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509451.483131:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509451.483171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796802176:0@lo:400:kworker.0 00000100:00100000:1.0:1788509451.483195:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509451.483225:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd891f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796802688:0@lo:400:kworker.0 00000100:00100000:1.0:1788509451.483247:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509451.483572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796801664 00000100:00100000:3.0:1788509451.483585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796801664 00000100:00100000:3.0:1788509451.483636:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796802176 00000100:00100000:3.0:1788509451.483640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796802176 00000100:00100000:3.0:1788509451.483664:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796802688 00000100:00100000:3.0:1788509451.483667:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796802688 00000100:00100000:3.0:1788509451.483686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788509451.483693:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796801664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509451.483740:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796801664:12345-0@lo:400:kworker.0 Request processed in 47us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509451.483747:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788509451.483772:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788509451.483778:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796802176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509451.483806:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796802176:12345-0@lo:400:kworker.0 Request processed in 28us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509451.483812:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788509451.483822:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788509451.483828:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796802688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509451.483855:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796802688:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509451.483861:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788509451.483876:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509451.484200:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796801664:0@lo:400:kworker.0 00010000:00080000:1.0:1788509451.484214:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87780000 x1875387796802176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509451.484225:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796802176:0@lo:400:kworker.0 00010000:00080000:1.0:1788509451.484235:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd891f9880 x1875387796802688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509451.484244:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd891f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796802688:0@lo:400:kworker.0 00000100:00100000:3.0:1788509451.991825:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509451.991853:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796802816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509451.991936:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509451.992015:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796802816 00000100:00100000:3.0:1788509451.992024:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796802816 00000100:00100000:3.0:1788509451.992076:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788509451.992086:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796802816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509451.992134:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509451.992183:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796802816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509451.992191:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788509451.992238:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796802816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509451.993410:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509451.993425:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796802944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509451.993475:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509451.994345:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796802944 00000100:00100000:1.0:1788509451.994366:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796802944 00000100:00100000:1.0:1788509451.994456:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788509451.994469:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796802944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788509451.994502:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509451.994879:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796802944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 410us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509451.994887:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788509452.004791:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796802944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788509452.182127:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509452.567434:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509452.567525:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774695296 00000100:00100000:1.0:1788509452.567540:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774695296 00000100:00100000:1.0:1788509452.567629:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 371 00000100:00100000:1.0:1788509452.567641:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774695296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509452.569702:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774695296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2044us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509452.569721:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 371 00000100:00100000:3.0:1788509452.576162:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509452.576208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509452.576760:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774695552 00000100:00100000:0.0:1788509452.576776:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774695552 00000100:00100000:0.0:1788509452.576938:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774695424 00000100:00100000:0.0:1788509452.576943:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774695424 00000100:00100000:0.0:1788509452.576976:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:0.0:1788509452.576990:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774695552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509452.577037:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:2.0:1788509452.577051:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774695424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509452.577089:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774695552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 102us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509452.577092:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774695424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509452.577102:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:2.0:1788509452.577109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00080000:3.0:1788509452.578175:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509452.578187:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509452.582827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509452.582881:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509452.582977:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509452.583159:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774695808 00000100:00100000:1.0:1788509452.583172:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774695808 00000100:00100000:1.0:1788509452.583292:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774695936 00000100:00100000:1.0:1788509452.583296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774695936 00000100:00100000:1.0:1788509452.583328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:1.0:1788509452.583340:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774695808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509452.583445:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774695808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 108us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509452.583454:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:1.0:1788509452.583504:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:1.0:1788509452.583512:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774695936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509452.583537:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774695936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509452.583544:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00080000:2.0:1788509452.584035:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509452.584047:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509452.584610:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774695680 00000100:00100000:0.0:1788509452.584622:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774695680 00000100:00100000:0.0:1788509452.584755:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788509452.584765:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2406:x1875387774695680:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:0.0:1788509452.584796:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dda82 00000100:00080000:0.0:1788509452.584806:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788509452.584869:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1788509452.585099:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+2:2406:x1875387774695680:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 334us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509452.585106:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00010000:00010000:1.0:1788509452.585735:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788509452.591679:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788509453.207340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509454.231972:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509455.254032:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509456.086408:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509456.086431:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796803072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509456.086501:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509456.086701:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796803072 00000100:00100000:2.0:1788509456.086710:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796803072 00000100:00100000:2.0:1788509456.086772:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788509456.086783:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796803072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509456.086819:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788509456.086874:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796803072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509456.086881:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788509456.086982:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796803072:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509456.278051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509456.598465:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509456.598486:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796803200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509456.598559:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509456.598634:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796803200 00000100:00100000:1.0:1788509456.598642:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796803200 00000100:00100000:1.0:1788509456.598699:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788509456.598707:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd891f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796803200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788509456.598749:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788509456.598800:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd891f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796803200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509456.598807:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788509456.598876:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796803200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509456.599136:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796803328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509456.599170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509456.599246:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796803328 00000100:00100000:2.0:1788509456.599251:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796803328 00000100:00100000:2.0:1788509456.599294:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788509456.599302:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796803328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788509456.599321:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509456.599354:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796803328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509456.599360:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1788509456.599391:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87356d80 x1875387796803328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509456.599406:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796803328:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788509456.599459:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509456.599985:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796803712:0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600017:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509456.600037:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796804224:0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600061:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509456.600078:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788509456.600084:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796803584:0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600104:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509456.600120:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796804096:0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509456.600168:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796804608:0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600187:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509456.600216:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796803712 00000100:00100000:3.0:1788509456.600221:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796803712 00000100:00100000:3.0:1788509456.600249:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796803584 00000100:00100000:3.0:1788509456.600251:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796803584 00000100:00100000:3.0:1788509456.600267:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788509456.600285:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796803712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600324:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796803712:12345-0@lo:400:kworker.0 Request processed in 40us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509456.600331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788509456.600345:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788509456.600351:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796803584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600375:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796803584:12345-0@lo:400:kworker.0 Request processed in 24us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509456.600381:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788509456.600401:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796804224 00000100:00100000:3.0:1788509456.600404:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796804224 00000100:00100000:3.0:1788509456.600429:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796804096 00000100:00100000:3.0:1788509456.600432:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796804096 00000100:00100000:3.0:1788509456.600443:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796804608 00000100:00100000:3.0:1788509456.600446:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796804608 00000100:00100000:3.0:1788509456.600457:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788509456.600463:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796804224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600493:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796804224:12345-0@lo:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509456.600498:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788509456.600508:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788509456.600514:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796804096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600539:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796804096:12345-0@lo:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509456.600544:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788509456.600555:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788509456.600560:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796804608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600596:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796804608:12345-0@lo:400:kworker.0 Request processed in 36us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509456.600603:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788509456.600620:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509456.600623:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509456.600642:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796803584:0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600651:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796804096:0@lo:400:kworker.0 00010000:00080000:3.0:1788509456.600662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119f800 x1875387796804608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509456.600672:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796804608:0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796803712:0@lo:400:kworker.0 00000100:00100000:3.0:1788509456.600688:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796804224:0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601008:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796803840:0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601039:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509456.601080:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796804352:0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601103:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509456.601118:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788509456.601124:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796803456:0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601148:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509456.601165:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796803968:0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509456.601194:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796804480:0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601212:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509456.601234:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796803840 00000100:00100000:2.0:1788509456.601237:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796803840 00000100:00100000:2.0:1788509456.601262:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796804352 00000100:00100000:2.0:1788509456.601265:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796804352 00000100:00100000:2.0:1788509456.601276:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796803968 00000100:00100000:2.0:1788509456.601279:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796803968 00000100:00100000:2.0:1788509456.601289:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796804480 00000100:00100000:2.0:1788509456.601292:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796804480 00000100:00100000:2.0:1788509456.601305:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788509456.601310:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796803840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601346:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796803840:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509456.601352:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788509456.601365:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788509456.601370:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796804352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601397:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796804352:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509456.601403:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788509456.601422:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788509456.601427:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796803968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601455:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796803968:12345-0@lo:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509456.601460:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788509456.601471:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788509456.601476:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796804480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601499:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796804480:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509456.601505:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00010000:00080000:2.0:1788509456.601532:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78afb80 x1875387796803968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509456.601543:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796803968:0@lo:400:kworker.0 00010000:00080000:2.0:1788509456.601554:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb78adf80 x1875387796804480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509456.601563:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796804480:0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601572:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796803840:0@lo:400:kworker.0 00000100:00100000:2.0:1788509456.601580:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796804352:0@lo:400:kworker.0 00000100:00100000:0.0:1788509456.601651:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796803456 00000100:00100000:0.0:1788509456.601655:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796803456 00000100:00100000:0.0:1788509456.601689:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788509456.601695:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796803456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509456.601742:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796803456:12345-0@lo:400:kworker.0 Request processed in 47us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509456.601758:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788509456.601795:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796803456:0@lo:400:kworker.0 00000100:00080000:3.0:1788509456.602211:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509456.602216:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509456.602226:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796804736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509456.602260:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509456.606295:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796804736 00000100:00100000:0.0:1788509456.606309:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796804736 00000100:00100000:0.0:1788509456.606376:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788509456.606387:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796804736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509456.606412:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509456.606841:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796804736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 455us (4578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509456.606849:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1788509456.610815:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd812a8380 x1875387796804736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509456.610936:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796804736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509457.110192:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509457.110214:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796804864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509457.110279:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509457.110389:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796804864 00000100:00100000:0.0:1788509457.110397:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796804864 00000100:00100000:0.0:1788509457.110447:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788509457.110456:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796804864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509457.110485:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509457.110529:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796804864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509457.110536:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788509457.110577:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796804864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509457.112003:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509457.112018:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796804992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509457.112069:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509457.112249:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796804992 00000100:00100000:1.0:1788509457.112256:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796804992 00000100:00100000:1.0:1788509457.112298:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788509457.112307:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796804992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788509457.112326:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509457.112391:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796804992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509457.112398:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788509457.112486:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796804992:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788509457.302554:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509457.693295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509457.693341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509457.693452:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774696064 00000100:00100000:1.0:1788509457.693462:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774696064 00000100:00100000:1.0:1788509457.693521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 373 00000100:00100000:1.0:1788509457.693542:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774696064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509457.693616:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdc1e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774696064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509457.693640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 373 00000100:00100000:2.0:1788509457.694020:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509457.694789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509457.694845:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774696320 00000100:00100000:3.0:1788509457.694860:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774696320 00000100:00100000:3.0:1788509457.694928:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774696576 00000100:00100000:3.0:1788509457.694931:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774696576 00000100:00100000:3.0:1788509457.694955:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:3.0:1788509457.694963:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774696320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509457.695016:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774696320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 54us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509457.695024:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:3.0:1788509457.695039:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:3.0:1788509457.695046:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774696576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509457.695072:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774696576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509457.695079:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00080000:1.0:1788509457.698453:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509457.698584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509457.698688:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774696192 00000100:00100000:1.0:1788509457.698697:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774696192 00000100:00100000:1.0:1788509457.698764:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774696448 00000100:00100000:1.0:1788509457.698768:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774696448 00000100:00100000:1.0:1788509457.698790:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:1.0:1788509457.698799:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774696192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509457.698870:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774696192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (4082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509457.698878:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:1.0:1788509457.698928:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:1.0:1788509457.698936:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774696448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509457.698961:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774696448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509457.698967:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00080000:2.0:1788509457.699340:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788509458.326067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788509458.648638:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:2.0:1788509458.648652:0:8431:0:(genops.c:885:class_export_put()) final put ffff8bcc810b5800/d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:1.0:1788509458.651603:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc810b5800/d1c7a223-cc58-4f2c-be22-e37eba96eeae for lustre-OST0000 00000020:00000080:1.0:1788509458.651713:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc810b3800 for lustre-OST0000 00010000:00010000:1.0:1788509459.349997:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509460.374001:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788509460.823551:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788509460.831173:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788509461.210707:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796805120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509461.210794:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509461.210895:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796805120 00000100:00100000:1.0:1788509461.210917:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796805120 00000100:00100000:1.0:1788509461.210967:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788509461.210983:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796805120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509461.211032:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509461.211080:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796805120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509461.211086:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788509461.211150:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796805120:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509461.398066:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509461.718449:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796805504:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.718567:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.718687:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796805632:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.718739:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.718786:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796806144:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.718810:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.718829:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796806656:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.718863:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.718890:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788509461.718914:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796805248:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.718940:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.718959:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796805760:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.718977:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.719001:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796806272:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719019:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.719048:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796805376:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719070:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.719084:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796805888:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719102:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.719110:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796806400:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719126:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.719146:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796805632 00000100:00100000:3.0:1788509461.719153:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796805632 00000100:00100000:3.0:1788509461.719184:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796805760 00000100:00100000:3.0:1788509461.719186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796805760 00000100:00100000:3.0:1788509461.719205:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796806272 00000100:00100000:3.0:1788509461.719207:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796806272 00000100:00100000:3.0:1788509461.719216:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796805376 00000100:00100000:3.0:1788509461.719218:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796805376 00000100:00100000:3.0:1788509461.719225:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796805888 00000100:00100000:3.0:1788509461.719227:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796805888 00000100:00100000:3.0:1788509461.719238:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796806400 00000100:00100000:3.0:1788509461.719240:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796806400 00000100:00100000:3.0:1788509461.719254:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788509461.719262:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796805632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719307:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796805632:12345-0@lo:400:kworker.0 Request processed in 45us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509461.719313:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788509461.719326:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788509461.719331:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796805760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719352:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796805760:12345-0@lo:400:kworker.0 Request processed in 22us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509461.719363:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788509461.719376:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788509461.719380:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796806272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719416:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796806272:12345-0@lo:400:kworker.0 Request processed in 35us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509461.719422:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788509461.719432:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788509461.719437:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796805376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719461:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796805376:12345-0@lo:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509461.719466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788509461.719474:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788509461.719479:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796805888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719498:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796805888:12345-0@lo:400:kworker.0 Request processed in 19us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509461.719503:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788509461.719513:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788509461.719517:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796806400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.719537:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796806400:12345-0@lo:400:kworker.0 Request processed in 19us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509461.719541:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788509461.719555:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796806144 00000100:00100000:3.0:1788509461.719558:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796806144 00000100:00100000:3.0:1788509461.719579:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796806656 00000100:00100000:3.0:1788509461.719582:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796806656 00000100:00100000:0.0:1788509461.719784:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796806016:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.719811:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509461.719837:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796806528:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.719856:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509461.719880:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796805504 00000100:00100000:0.0:1788509461.719883:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796805504 00000100:00100000:0.0:1788509461.719925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788509461.719932:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796805504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.719968:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796805504:12345-0@lo:400:kworker.0 Request processed in 36us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509461.719974:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788509461.719992:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796806016 00000100:00100000:0.0:1788509461.719996:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796806016 00000100:00100000:0.0:1788509461.720012:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796806528 00000100:00100000:0.0:1788509461.720014:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796806528 00000100:00100000:0.0:1788509461.720027:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788509461.720033:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796806144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720061:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796806144:12345-0@lo:400:kworker.0 Request processed in 28us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509461.720067:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788509461.720077:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788509461.720084:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796806016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720108:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796806016:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509461.720113:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788509461.720122:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788509461.720127:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796806528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720152:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796806528:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509461.720166:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788509461.720206:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796805504:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720216:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796806016:0@lo:400:kworker.0 00010000:00080000:0.0:1788509461.720226:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913e4a80 x1875387796806528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509461.720235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796806528:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720302:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796805248 00000100:00100000:0.0:1788509461.720306:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796805248 00000100:00100000:0.0:1788509461.720333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788509461.720339:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796805248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720371:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8529ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796805248:12345-0@lo:400:kworker.0 Request processed in 31us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509461.720377:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:0.0:1788509461.720417:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509461.720421:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509461.720423:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509461.720425:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509461.720444:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796805248:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720455:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796805760:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720464:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796806272:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720474:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796805632:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720483:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796806144:0@lo:400:kworker.0 00000100:00100000:0.0:1788509461.720534:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796805376:0@lo:400:kworker.0 00010000:00080000:0.0:1788509461.720544:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87783100 x1875387796805888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509461.720553:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796805888:0@lo:400:kworker.0 00010000:00080000:0.0:1788509461.720561:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913e5c00 x1875387796806400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509461.720569:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796806400:0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.720731:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788509461.720737:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796806656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509461.720775:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796806656:12345-0@lo:400:kworker.0 Request processed in 39us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509461.720781:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788509461.720797:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788509461.720816:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913e4380 x1875387796806656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509461.720827:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796806656:0@lo:400:kworker.0 00000100:00100000:1.0:1788509461.721187:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796806784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509461.721219:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509461.721259:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796806784 00000100:00100000:1.0:1788509461.721263:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796806784 00000100:00100000:1.0:1788509461.721292:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788509461.721299:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796806784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788509461.721325:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788509461.721362:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796806784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509461.721368:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788509461.721411:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796806784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509461.721963:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796807040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509461.721998:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509461.722021:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509461.722027:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796806912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509461.722048:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509461.722750:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796807040 00000100:00100000:3.0:1788509461.722757:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796807040 00000100:00100000:3.0:1788509461.722808:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796806912 00000100:00100000:3.0:1788509461.722812:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796806912 00000100:00100000:3.0:1788509461.722827:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788509461.722834:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796807040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509461.722858:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509461.723442:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788509461.723454:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796806912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509461.723489:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509461.723537:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796806912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509461.723544:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788509461.724264:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796807040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1428us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509461.724272:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1788509461.727050:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3c700 x1875387796806912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509461.727077:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796806912:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788509461.727102:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc865dd180 x1875387796807040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509461.727113:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796807040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509462.230072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796807168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509462.230142:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509462.230196:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509462.230203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796807296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509462.230228:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509462.230272:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796807168 00000100:00100000:3.0:1788509462.230279:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796807168 00000100:00100000:3.0:1788509462.230333:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796807296 00000100:00100000:3.0:1788509462.230343:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796807296 00000100:00100000:3.0:1788509462.230362:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788509462.230369:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796807168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509462.230396:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509462.230437:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796807168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509462.230445:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788509462.230460:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788509462.230466:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796807296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509462.230474:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509462.230495:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796807296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509462.230501:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788509462.230541:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796807296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509462.230554:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796807168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788509462.423000:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509462.804237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509462.804328:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509462.804365:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509462.804393:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509462.804419:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774696832 00000100:00100000:3.0:1788509462.804428:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774696832 00000100:00100000:3.0:1788509462.804498:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774696960 00000100:00100000:3.0:1788509462.804501:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774696960 00000100:00100000:3.0:1788509462.804516:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774697216 00000100:00100000:3.0:1788509462.804519:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774697216 00000100:00100000:3.0:1788509462.804536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 265 00000100:00100000:3.0:1788509462.804545:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774696832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509462.804752:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774696832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 207us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509462.804760:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 265 00000100:00100000:3.0:1788509462.804777:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 266 00000100:00100000:3.0:1788509462.804784:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774696960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509462.804810:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774696960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509462.804816:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 266 00000100:00100000:3.0:1788509462.804828:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 267 00000100:00100000:3.0:1788509462.804834:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774697216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509462.804856:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774697216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509462.804862:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 267 00000100:00080000:3.0:1788509462.804876:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509462.804880:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509462.807315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509462.807353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774697088 00000100:00100000:3.0:1788509462.807361:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774697088 00000100:00100000:3.0:1788509462.807416:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 268 00000100:00100000:3.0:1788509462.807424:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774697088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509462.810809:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774697088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3373us (3490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509462.810824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 268 00000100:00080000:3.0:1788509462.810866:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509462.814607:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774696704 00000100:00100000:0.0:1788509462.814622:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774696704 00000100:00100000:0.0:1788509462.814687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 375 00000100:00100000:0.0:1788509462.814697:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774696704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509462.814773:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774696704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (10544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509462.814780:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 375 00010000:00010000:1.0:1788509463.446050:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509464.470043:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788509464.677871:0:14061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:11:02 (1788509462) 00010000:00010000:1.0:1788509465.494953:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509466.326299:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509466.326323:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796807424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509466.326404:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509466.326538:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796807424 00000100:00100000:1.0:1788509466.326546:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796807424 00000100:00100000:1.0:1788509466.326593:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788509466.326603:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796807424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509466.326635:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509466.326751:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796807424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509466.326759:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788509466.327034:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796807424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509466.464637:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509466.464752:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774697344 00000100:00100000:2.0:1788509466.464763:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774697344 00000100:00100000:2.0:1788509466.464837:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1788509466.464850:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:11083:x1875387774697344:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509466.464870:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509466.464979:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddb62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553064 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509466.465058:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddb69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509466.465073:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddb69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509466.465086:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddb69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509466.465145:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788509466.465149:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509466.465198:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddb69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509466.465223:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddb62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553064 expref: 7 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509466.465260:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddb69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553064 expref: 6 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509466.465268:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcd8399bb00) 00010000:00010000:2.0:1788509466.465271:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788509466.465274:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226000, rc 0) 00000100:00100000:2.0:1788509466.465331:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:11083:x1875387774697344:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 484us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509466.465339:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00080000:3.0:1788509466.466813:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509466.480049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509466.480595:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774697472 00000100:00100000:3.0:1788509466.480606:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774697472 00000100:00100000:3.0:1788509466.480679:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1788509466.480690:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:11084:x1875387774697472:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509466.480710:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509466.480731:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddb70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755306b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480791:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480806:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480816:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480842:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480849:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480856:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480946:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310ddb85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480970:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310ddb85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.480977:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310ddb85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509466.481028:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788509466.481032:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788509466.481052:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310ddb85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481061:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481068:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481074:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481079:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4a000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509466.481083:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481091:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481102:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcd8399bb00) 00010000:00010000:3.0:1788509466.481105:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509466.481109:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481126:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddb77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481141:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481148:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481154:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481158:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4ac00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509466.481161:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481167:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481175:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8bcd83aef700) 00010000:00010000:3.0:1788509466.481177:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509466.481180:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481184:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddb7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481213:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddb70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755306b expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481226:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310ddb85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755306b expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509466.481240:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8bcd83aef800) 00010000:00010000:3.0:1788509466.481243:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788509466.481245:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4be00, rc 0) 00000100:00100000:3.0:1788509466.481319:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:11084:x1875387774697472:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 630us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509466.481326:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788509466.485890:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509466.486331:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774697600 00000100:00100000:3.0:1788509466.486341:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774697600 00000100:00100000:3.0:1788509466.486400:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788509466.486410:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:11084:x1875387774697600:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788509466.486494:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:11084:x1875387774697600:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 86us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509466.486514:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788509466.501037:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509466.501625:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774697856 00000100:00100000:1.0:1788509466.501637:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774697856 00000100:00100000:1.0:1788509466.501730:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788509466.501741:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:11084:x1875387774697856:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509466.501761:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509466.501782:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddb8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553072 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.501872:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.501888:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.501947:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502219:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502229:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502237:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502349:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddba1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502357:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddba1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502363:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddba1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509466.502384:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788509466.502482:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502490:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502496:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.502893:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8e00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509466.503127:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503139:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503152:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8bcd83aef800) 00010000:00010000:1.0:1788509466.503155:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509466.503160:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503166:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddb93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503179:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503186:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503205:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503210:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509466.503214:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503220:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503227:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8bcc87343b00) 00010000:00010000:1.0:1788509466.503230:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509466.503233:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.503239:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddb9a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.504773:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddb8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553072 expref: 10 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.504800:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddba1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553072 expref: 9 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509466.504809:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:1.0:1788509466.504812:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509466.504815:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9400, rc 0) 00000100:00100000:1.0:1788509466.506702:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:11084:x1875387774697856:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3187us (3899us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788509466.506740:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00010000:00010000:1.0:1788509466.518272:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509466.523203:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509466.524342:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774697984 00000100:00100000:3.0:1788509466.524355:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774697984 00000100:00100000:3.0:1788509466.524424:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788509466.524435:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:11084:x1875387774697984:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788509466.524572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:11084:x1875387774697984:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 138us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509466.524579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788509466.531450:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509466.531674:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774698112 00000100:00100000:2.0:1788509466.531684:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774698112 00000100:00100000:2.0:1788509466.531756:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788509466.531767:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:11084:x1875387774698112:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788509466.532269:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788509466.541341:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9531us 00000100:00100000:3.0:1788509466.563140:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:11084:x1875387774698112:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 31364us (31696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509466.563166:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788509466.838408:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796807680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509466.838409:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796807552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509466.839218:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.839809:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.839890:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796807808:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.839942:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.839983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796807808 00000100:00100000:0.0:1788509466.839991:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796807808 00000100:00100000:0.0:1788509466.840042:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788509466.840050:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796807808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840109:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd923b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796807808:12345-0@lo:400:kworker.0 Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.840117:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788509466.840162:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796807808:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840202:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796807936:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840229:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.840257:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796807936 00000100:00100000:0.0:1788509466.840260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796807936 00000100:00100000:0.0:1788509466.840287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788509466.840293:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796807936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796807936:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.840331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788509466.840360:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796807936:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840443:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796808448:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840465:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.840482:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796808960:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840500:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.840516:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788509466.840521:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796808064:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840539:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.840552:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796808576:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840572:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.840586:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796809088:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840615:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.840638:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796808448 00000100:00100000:0.0:1788509466.840654:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796808448 00000100:00100000:0.0:1788509466.840685:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796808960 00000100:00100000:0.0:1788509466.840688:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796808960 00000100:00100000:0.0:1788509466.840701:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796808064 00000100:00100000:0.0:1788509466.840704:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796808064 00000100:00100000:0.0:1788509466.840717:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788509466.840722:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796808448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840754:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796808448:12345-0@lo:400:kworker.0 Request processed in 31us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.840760:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788509466.840771:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788509466.840777:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796808960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840801:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796808960:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.840807:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788509466.840816:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788509466.840821:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796808064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840843:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796808064:12345-0@lo:400:kworker.0 Request processed in 22us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.840849:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788509466.840868:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796808576 00000100:00100000:0.0:1788509466.840871:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796808576 00000100:00100000:0.0:1788509466.840891:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796809088 00000100:00100000:0.0:1788509466.840894:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796809088 00000100:00100000:0.0:1788509466.840932:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788509466.840938:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796808576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.840975:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796808576:12345-0@lo:400:kworker.0 Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.840982:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788509466.840992:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788509466.840998:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796809088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841022:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796809088:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.841028:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788509466.841045:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509466.841049:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509466.841051:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509466.841063:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796808320:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841085:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.841101:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796808832:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.841147:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788509466.841153:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796808192:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841174:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.841189:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796808704:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841207:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.841218:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796809216:0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841235:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509466.841256:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796807552 00000100:00100000:0.0:1788509466.841259:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796807552 00000100:00100000:0.0:1788509466.841281:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796808192 00000100:00100000:0.0:1788509466.841283:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796808192 00000100:00100000:0.0:1788509466.841303:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788509466.841308:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796807552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509466.841334:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788509466.841365:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796807552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.841371:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788509466.841381:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788509466.841387:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796808192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841414:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796808192:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.841421:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788509466.841438:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796808704 00000100:00100000:0.0:1788509466.841441:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796808704 00000100:00100000:0.0:1788509466.841458:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796809216 00000100:00100000:0.0:1788509466.841461:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796809216 00000100:00100000:0.0:1788509466.841472:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788509466.841478:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796808704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841514:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796808704:12345-0@lo:400:kworker.0 Request processed in 36us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.841521:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788509466.841531:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788509466.841537:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796809216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509466.841559:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796809216:12345-0@lo:400:kworker.0 Request processed in 23us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509466.841565:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788509466.841577:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796808320 00000100:00100000:0.0:1788509466.841585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796808320 00000100:00100000:0.0:1788509466.841605:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796808832 00000100:00100000:0.0:1788509466.841607:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796808832 00000100:00100000:0.0:1788509466.841622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788509466.841628:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796808320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509466.841831:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788509466.841840:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796808832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509466.841874:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796808832:12345-0@lo:400:kworker.0 Request processed in 36us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509466.841879:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788509466.841934:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796808064:0@lo:400:kworker.0 00000100:00100000:2.0:1788509466.841944:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796808576:0@lo:400:kworker.0 00010000:00080000:2.0:1788509466.841972:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb789a680 x1875387796809088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509466.841996:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796809088:0@lo:400:kworker.0 00010000:00080000:2.0:1788509466.842010:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913e5c00 x1875387796808448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509466.842017:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796808448:0@lo:400:kworker.0 00010000:00080000:2.0:1788509466.842026:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd812a9500 x1875387796808960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509466.842033:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796808960:0@lo:400:kworker.0 00000100:00100000:2.0:1788509466.842059:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788509466.842067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796809344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509466.842095:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509466.842134:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796807552:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788509466.842160:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509466.842163:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788509466.842165:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509466.842179:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796808192:0@lo:400:kworker.0 00000100:00100000:2.0:1788509466.842192:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796808704:0@lo:400:kworker.0 00010000:00080000:2.0:1788509466.842200:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7898380 x1875387796809216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509466.842207:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796809216:0@lo:400:kworker.0 00000100:00100000:2.0:1788509466.842215:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796808832:0@lo:400:kworker.0 00000100:00100000:3.0:1788509466.842792:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796807680 00000100:00100000:3.0:1788509466.842799:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796807680 00000100:00100000:3.0:1788509466.842850:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796809344 00000100:00100000:3.0:1788509466.842855:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796809344 00000100:00100000:3.0:1788509466.842870:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788509466.842878:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796807680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509466.842924:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509466.842984:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796807680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509466.842991:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788509466.843005:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788509466.843011:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796809344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509466.843021:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509466.843110:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796808320:0@lo:400:kworker.0 00010000:00080000:2.0:1788509466.846750:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7870a80 x1875387796807680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509466.846780:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796807680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509466.850691:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796809344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7671us (8586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509466.850706:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788509466.850861:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796808320:12345-0@lo:400:kworker.0 Request processed in 9013us (9554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509466.850880:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00080000:2.0:1788509466.853384:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87c3d180 x1875387796809344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509466.853411:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796809344:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788509466.968003:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788509466.971180:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788509467.351311:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509467.351335:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796809472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509467.351407:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509467.351475:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796809472 00000100:00100000:0.0:1788509467.351482:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796809472 00000100:00100000:0.0:1788509467.351527:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788509467.351537:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796809472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509467.351564:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509467.351611:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796809472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509467.351618:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788509467.351682:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796809472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509467.351808:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796809600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509467.351834:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509467.351939:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796809600 00000100:00100000:1.0:1788509467.351944:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796809600 00000100:00100000:1.0:1788509467.351977:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788509467.351984:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796809600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788509467.351996:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509467.352038:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796809600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509467.352044:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788509467.352187:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796809600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788509467.542135:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509467.923358:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509467.923439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774698240 00000100:00100000:0.0:1788509467.923449:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774698240 00000100:00100000:0.0:1788509467.923509:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 377 00000100:00100000:0.0:1788509467.923519:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2407:x1875387774698240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509467.923605:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2407:x1875387774698240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509467.923630:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 377 00000100:00100000:1.0:1788509467.938747:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509467.938827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509467.942125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509467.942506:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774698368 00000100:00100000:2.0:1788509467.942515:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774698368 00000100:00100000:2.0:1788509467.942648:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774698624 00000100:00100000:2.0:1788509467.942653:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774698624 00000100:00100000:2.0:1788509467.942688:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:2.0:1788509467.942698:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774698368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509467.942770:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774698368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509467.942778:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:2.0:1788509467.942795:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00100000:2.0:1788509467.942801:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774698624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509467.942823:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774698624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (3997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509467.942829:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00080000:2.0:1788509467.942844:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509467.945623:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509467.945668:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774698496 00000100:00100000:1.0:1788509467.945677:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774698496 00000100:00100000:1.0:1788509467.945715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774698752 00000100:00100000:1.0:1788509467.945718:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774698752 00000100:00100000:1.0:1788509467.945739:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 277 00000100:00100000:1.0:1788509467.945748:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774698496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509467.945825:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774698496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (3708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509467.945833:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 277 00000100:00100000:1.0:1788509467.945861:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:1.0:1788509467.945867:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774698752:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509467.945887:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774698752:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509467.945892:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00080000:1.0:1788509467.945933:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788509468.570084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509468.932741:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509468.933204:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774698880 00000100:00100000:1.0:1788509468.933216:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774698880 00000100:00100000:1.0:1788509468.933324:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788509468.933337:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:11126:x1875387774698880:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509468.933356:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509468.933376:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddbaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933441:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933456:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933469:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933484:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933504:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933511:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933557:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933565:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933571:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933577:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509468.933581:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933589:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933601:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcd8399bb00) 00010000:00010000:1.0:1788509468.933604:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509468.933609:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933615:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddbb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933638:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933651:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933656:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933661:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509468.933664:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933671:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933679:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8bcc87343b00) 00010000:00010000:1.0:1788509468.933682:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509468.933685:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933691:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddbbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933726:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddbaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553079 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933736:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcd8399bb00) 00010000:00010000:1.0:1788509468.933739:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509468.933742:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddbaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553079 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509468.933751:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9c00, rc 0) 00000100:00100000:1.0:1788509468.933818:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:11126:x1875387774698880:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 485us (1088us total) trans 0 rc 301/301 00000100:00100000:1.0:1788509468.933826:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00080000:2.0:1788509468.941174:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509468.941982:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509468.942204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774699136 00000100:00100000:3.0:1788509468.942215:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774699136 00000100:00100000:3.0:1788509468.942277:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788509468.942287:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:11126:x1875387774699136:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1788509468.942345:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509468.942372:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddb69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553064 expref: 9 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.942403:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcd8399bb00) 00010000:00010000:3.0:1788509468.942417:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509468.942481:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.942493:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.942503:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.942516:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.942523:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.942529:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943054:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943063:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943070:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788509468.943082:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1d5d32a reply state 000000005bba4b59 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943104:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943111:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:3.0:1788509468.943113:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788509468.943116:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788509468.943120:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788509468.943128:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943135:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943143:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943148:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509468.943152:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943159:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943167:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcd8cb0da00) 00010000:00010000:3.0:1788509468.943169:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509468.943173:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943179:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbc4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788509468.943214:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1d5d32a reply state 000000005bba4b59 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943222:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509468.943229:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8bcd8cb0d800) 00010000:00010000:3.0:1788509468.943231:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788509468.943233:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788509468.943334:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:11126:x1875387774699136:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 1048us (1355us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788509468.943342:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1788509469.044036:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.044078:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774699264 00000100:00100000:2.0:1788509469.044089:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774699264 00000100:00100000:0.0:1788509469.044163:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788509469.044175:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:11134:x1875387774699264:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:0.0:1788509469.044198:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509469.044220:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddbd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553080 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.044278:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310ddbe0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.044291:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310ddbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.044302:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310ddbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509469.044346:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788509469.044349:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509469.044383:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310ddbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.044405:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddbd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553080 expref: 12 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.044432:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310ddbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553080 expref: 11 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.044441:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:0.0:1788509469.044456:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509469.044460:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590aa00, rc 0) 00000100:00100000:0.0:1788509469.044512:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:11134:x1875387774699264:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 340us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.044519:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1788509469.109049:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509469.111093:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774699392 00000100:00100000:3.0:1788509469.111107:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774699392 00000100:00100000:3.0:1788509469.111203:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1788509469.111213:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:11140:x1875387774699392:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788509469.111233:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509469.111255:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553087 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111317:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111337:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111349:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111383:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111391:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111398:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111465:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030000/0xe5156b86310ddbfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111484:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030000/0xe5156b86310ddbfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111492:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030000/0xe5156b86310ddbfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509469.111526:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788509469.111529:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788509469.111564:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030000/0xe5156b86310ddbfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111574:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111580:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111586:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111601:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4b800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509469.111605:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111612:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111625:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:3.0:1788509469.111637:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509469.111642:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddbee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111663:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111668:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111674:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111679:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509469.111681:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111689:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111707:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8bcd8cb0d800) 00010000:00010000:3.0:1788509469.111709:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509469.111712:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.111717:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310ddbf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.112584:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddbe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553087 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.112605:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030000/0xe5156b86310ddbfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553087 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.112612:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:3.0:1788509469.112615:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788509469.112617:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030000, rc 0) 00000100:00100000:3.0:1788509469.113411:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:11140:x1875387774699392:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2195us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509469.113420:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788509469.120403:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.120552:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774699648 00000100:00100000:0.0:1788509469.120562:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774699648 00000100:00100000:0.0:1788509469.120624:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1788509469.120644:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:11140:x1875387774699648:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509469.120662:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509469.120681:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc03 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755308e expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.120786:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.120801:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.120813:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.120864:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.120872:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.120879:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788509469.121401:0:9006:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788509469.121542:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121551:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121560:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121590:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121597:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121604:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121610:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509469.121614:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121621:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121642:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509469.121646:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509469.121650:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121669:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddc0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509469.121682:0:9006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b1d5e5c reply state 000000005c704f5b transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121693:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121700:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bb300) 00010000:00010000:0.0:1788509469.121702:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509469.121705:0:9006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788509469.121735:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 15 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121749:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 14 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.121757:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb600) 00010000:00010000:0.0:1788509469.121759:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509469.121762:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590ac00, rc 0) 00000100:00100000:0.0:1788509469.122393:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11140:x1875387774699648:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1750us (1997us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788509469.122403:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788509469.130311:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.130416:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774699776 00000100:00100000:0.0:1788509469.130425:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774699776 00000100:00100000:0.0:1788509469.130483:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788509469.130492:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875387774699776:12345-192.168.203.12@tcp:8:bash.0 00010000:00080000:0.0:1788509469.130554:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp t0 exp 0000000000000000 cur 366 last 0 00000020:00000080:0.0:1788509469.130583:0:8438:0:(genops.c:1385:class_connect()) connect: client d1c7a223-cc58-4f2c-be22-e37eba96eeae, cookie 0xe5156b86310ddc26 00002000:00100000:0.0:1788509469.130594:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d1c7a223-cc58-4f2c-be22-e37eba96eeae/ffff8bcc87c81000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788509469.130611:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788509469.130693:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788509469.130724:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcc87c87000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509469.130960:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2406:x1875387774699776:12345-192.168.203.12@tcp:8:bash.0 Request processed in 466us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.130978:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788509469.134394:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.138330:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774699904 00000100:00100000:0.0:1788509469.138346:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774699904 00000100:00100000:0.0:1788509469.138437:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788509469.138448:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:0:x1875387774699904:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509469.138464:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509469.138487:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553095 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788509469.138513:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:2.0:1788509469.138760:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788509469.138847:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1788509469.138853:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509469.138864:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.138888:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.138958:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a800, rc 0) 00000100:00100000:0.0:1788509469.139031:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:0:x1875387774699904:12345-192.168.203.12@tcp:101:bash.0 Request processed in 584us (4647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.139038:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1788509469.142124:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.142399:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774700032 00000100:00100000:0.0:1788509469.142408:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774700032 00000100:00100000:0.0:1788509469.142470:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1788509469.142480:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:11140:x1875387774700032:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509469.142498:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509469.142519:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755309c expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.142561:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.142570:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509469.142575:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509469.142580:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.142612:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.142635:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 8 pid: 8437 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509469.142665:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1875387796809728:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509469.142770:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd922efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509469.145448:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1875387796809728:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509469.145481:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.145501:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a400, rc 0) 00000100:00100000:1.0:1788509469.146995:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.147088:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774700160 00000100:00100000:2.0:1788509469.147097:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774700160 00010000:00010000:2.0:1788509469.147136:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 9 pid: 8437 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509469.147177:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788509469.147186:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2407:x1875387774700160:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509469.147199:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509469.147220:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 9 pid: 8437 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.147234:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 9 pid: 8437 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.147258:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092109af9/0xe5156b86310ddc2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553095 expref: 9 pid: 8437 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.147274:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509469.147278:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509469.147286:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.147316:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.147354:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509469.147369:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1875387796809856:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788509469.147676:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8331ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509469.148447:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:11140:x1875387774700032:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5964us (6327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.148457:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1788509469.153111:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1875387796809856:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788509469.153137:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509469.153200:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774700160:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 6014us (6210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.153211:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788509469.155727:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.155946:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774700416 00000100:00100000:2.0:1788509469.155955:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774700416 00000100:00100000:2.0:1788509469.156016:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788509469.156026:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11140:x1875387774700416:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788509469.156302:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11140:x1875387774700416:12345-192.168.203.12@tcp:35:bash.0 Request processed in 276us (583us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788509469.156309:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788509469.263649:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.263746:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774700672 00000100:00100000:2.0:1788509469.263755:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774700672 00000100:00100000:2.0:1788509469.263856:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788509469.263866:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11150:x1875387774700672:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509469.263890:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509469.263929:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddc3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530a3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509469.264028:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788509469.264142:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddc3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530a3 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.264156:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:2.0:1788509469.264159:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788509469.264164:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddc3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530a3 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.264178:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227800, rc 0) 00000100:00100000:2.0:1788509469.264293:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11150:x1875387774700672:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 427us (653us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788509469.264300:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:1.0:1788509469.274936:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.275087:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774700928 00000100:00100000:2.0:1788509469.275098:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774700928 00000100:00100000:2.0:1788509469.275159:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788509469.275170:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11150:x1875387774700928:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788509469.275390:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11150:x1875387774700928:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 221us (462us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788509469.275398:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788509469.433328:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.433434:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774701056 00000100:00100000:0.0:1788509469.433444:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774701056 00000100:00100000:0.0:1788509469.433506:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788509469.433517:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11156:x1875387774701056:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509469.433539:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509469.433559:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.433842:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddc50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.433868:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.433881:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509469.433963:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788509469.433967:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509469.433989:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddc50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.434017:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530aa expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.434036:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddc50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530aa expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.434044:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509469.434047:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509469.434050:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a600, rc 0) 00000100:00100000:0.0:1788509469.434116:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11156:x1875387774701056:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 601us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.434124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788509469.444502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.444767:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774701312 00000100:00100000:2.0:1788509469.444781:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774701312 00000100:00100000:2.0:1788509469.444856:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788509469.444868:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11156:x1875387774701312:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509469.445114:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509469.445144:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddc57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530b1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.445313:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddc5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.445332:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddc5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.445482:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddc5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509469.445497:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788509469.445648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddc57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530b1 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.445754:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddc5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530b1 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.445765:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb600) 00010000:00010000:2.0:1788509469.445769:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509469.446278:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227800, rc 0) 00000100:00100000:2.0:1788509469.446377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:11156:x1875387774701312:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1509us (1888us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788509469.446386:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788509469.450312:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.450367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509469.450683:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774701696 00000100:00100000:1.0:1788509469.450697:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774701696 00000100:00100000:1.0:1788509469.450779:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788509469.450791:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:2410:x1875387774701696:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509469.450811:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509469.450847:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddc5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530b1 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.450872:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb600) 00010000:00010000:1.0:1788509469.450879:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509469.451003:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:2410:x1875387774701696:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 204us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509469.451013:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788509469.451427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774701568 00000100:00100000:0.0:1788509469.451434:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774701568 00000100:00100000:0.0:1788509469.451487:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788509469.451495:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:11156:x1875387774701568:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509469.451519:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509469.451540:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.451688:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddc73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.451705:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddc73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.451718:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddc73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509469.451732:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788509469.451856:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530b8 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.451874:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddc73 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530b8 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.451887:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb600) 00010000:00010000:0.0:1788509469.451890:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788509469.451929:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b000, rc 0) 00000100:00100000:0.0:1788509469.452324:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11156:x1875387774701568:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 828us (2024us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788509469.452333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1788509469.460622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.460778:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774701824 00000100:00100000:0.0:1788509469.460807:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774701824 00000100:00100000:0.0:1788509469.460876:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1788509469.460887:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774701824:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:0.0:1788509469.460988:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.461021:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.461031:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509469.461036:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788509469.461041:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.461086:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.461101:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 7 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509469.461119:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875387796809984:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509469.461230:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd922efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509469.464345:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875387796809984:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509469.464385:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509469.465514:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509469.466202:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774701952 00000100:00100000:1.0:1788509469.466215:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774701952 00002000:00100000:1.0:1788509469.466281:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8bcdb789a680 x1875387774701952/t0(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:550/0 lens 504/0 e 0 to 0 dl 1788509480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509469.466293:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcdb789a680 with x1875387774701952 ext(0->12) 00010000:00010000:1.0:1788509469.466302:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 8 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.466321:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 8 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788509469.466329:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bcdb789a680 00000100:00100000:1.0:1788509469.466368:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788509469.466380:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774701952:12345-192.168.203.12@tcp:4:lfs.0 00000001:00100000:2.0:1788509469.481473:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000100:00100000:1.0:1788509469.494153:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774701952:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 27765us (28638us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788509469.494168:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:1.0:1788509469.494181:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8bcdb789a680 x1875387774701952/t4294967300(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:550/0 lens 504/448 e 0 to 0 dl 1788509480 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509469.494191:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcdb789a680 with x1875387774701952 ext(0->12) 00010000:00010000:1.0:1788509469.494202:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 9 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.494221:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 9 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788509469.494249:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bcdb789a680 00000100:00100000:3.0:1788509469.501044:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509469.508948:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774702080 00000100:00100000:1.0:1788509469.508964:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774702080 00010000:00010000:1.0:1788509469.509020:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 9 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509469.509060:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:1.0:1788509469.509069:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2409:x1875387774702080:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509469.509084:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788509469.509101:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788509469.509104:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788509468 00002000:00010000:1.0:1788509469.509106:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788509468 00002000:00010000:1.0:1788509469.509108:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788509468 00002000:00010000:1.0:1788509469.509110:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788509469.509116:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 9 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.509130:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 9 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.509155:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ddae36/0xe5156b86310ddc34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755309c expref: 9 pid: 8438 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.509173:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509469.509177:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509469.509198:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.509209:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.509247:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509469.509314:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2409:x1875387774702080:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 245us (8282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509469.509323:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00010000:00010000:3.0:1788509469.509347:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.509368:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.509438:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.509448:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.509459:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.509467:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509469.509472:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.509483:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.509506:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.509515:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f52f94e1/0xe5156b86310ddc81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509469.509614:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774701824:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 48726us (49002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509469.509636:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1788509469.514438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.514546:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774702336 00000100:00100000:2.0:1788509469.514560:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774702336 00000100:00100000:2.0:1788509469.514635:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788509469.514647:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11156:x1875387774702336:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:2.0:1788509469.514837:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddc73 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530b8 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788509469.516172:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788509469.516224:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788509469.516586:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788509469.516638:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.518895:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 26 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.518949:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.519035:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 26 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.519054:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 26 pid: 9006 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509469.519075:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875387796810112:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509469.519204:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8331b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788509469.522223:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875387796810112:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509469.522273:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509469.533267:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509469.533540:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774702464 00000100:00100000:1.0:1788509469.533555:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774702464 00010000:00010000:1.0:1788509469.533607:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 27 pid: 9006 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509469.533664:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:1.0:1788509469.533674:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:2410:x1875387774702464:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509469.533688:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509469.533695:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 27 pid: 9006 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.533708:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 27 pid: 9006 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.533731:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddc18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755308e expref: 27 pid: 9006 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.533750:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb600) 00010000:00010000:1.0:1788509469.533769:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.533779:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.533787:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.533819:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509469.533885:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+26:2410:x1875387774702464:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 213us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509469.533892:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00010000:00010000:3.0:1788509469.536388:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.536411:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788509469.536582:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788509469.536741:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788509469.536863:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796810240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788509469.537017:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509469.537061:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509469.537095:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796810240 00000100:00100000:0.0:1788509469.537110:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796810240 00000100:00100000:0.0:1788509469.537203:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788509469.537215:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796810240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788509469.537356:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796810240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.537364:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1788509469.537549:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509469.540097:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796810240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788509469.540367:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788509469.540466:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796810368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788509469.541136:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509469.541186:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509469.541231:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796810368 00000100:00100000:1.0:1788509469.541245:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796810368 00000100:00100000:1.0:1788509469.541302:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788509469.541312:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796810368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788509469.541543:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875387796810368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 232us (409us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788509469.541551:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788509469.542891:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796810368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788509469.544159:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788509469.544243:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.544257:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.544277:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.544283:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509469.544288:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.544297:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.544316:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb600) 00010000:00010000:3.0:1788509469.544318:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788509469.544323:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509469.544330:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddc88 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788509469.544480:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788509469.544572:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788509469.544586:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366705687479ns, next at 367705684501ns, rc = 0 00000001:00080000:3.0:1788509469.544593:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788509469.544621:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb600) 00010000:00010000:3.0:1788509469.544633:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788509469.544643:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddc73 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530b8 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509469.548294:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:11156:x1875387774702336:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 33635us (33858us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788509469.548333:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000020:00080000:3.0:1788509469.548341:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788509469.552083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.554014:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774702592 00000100:00100000:0.0:1788509469.554035:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774702592 00000100:00100000:0.0:1788509469.554135:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788509469.554149:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:11156:x1875387774702592:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509469.554179:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509469.554210:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530bf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.554285:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530bf expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.554301:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530bf expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.554324:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509469.554327:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788509469.554332:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a800, rc 0) 00000100:00100000:0.0:1788509469.554417:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:11156:x1875387774702592:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 271us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.554443:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1788509469.558740:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509469.558850:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774702848 00000100:00100000:3.0:1788509469.558864:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774702848 00000100:00100000:3.0:1788509469.558963:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788509469.558985:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:11156:x1875387774702848:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788509469.559281:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+31:11156:x1875387774702848:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 306us (554us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788509469.559290:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00010000:00010000:3.0:1788509469.593083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509469.657262:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.657781:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774703104 00000100:00100000:0.0:1788509469.657791:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774703104 00000100:00100000:0.0:1788509469.657986:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1788509469.657997:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+31:11166:x1875387774703104:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509469.658022:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509469.658043:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddc96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509469.658136:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788509469.658231:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddc96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530c6 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.658243:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:0.0:1788509469.658246:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509469.658251:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddc96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530c6 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.658264:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590ae00, rc 0) 00000100:00100000:0.0:1788509469.658316:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:11166:x1875387774703104:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 321us (1065us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788509469.658323:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788509469.667819:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509469.668170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774703232 00000100:00100000:0.0:1788509469.668180:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774703232 00000100:00100000:0.0:1788509469.668244:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788509469.668255:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:11166:x1875387774703232:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788509469.668419:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668438:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668450:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668462:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668548:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668632:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668641:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668647:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509469.668696:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668710:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668726:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668732:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668738:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509469.668743:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668750:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668762:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509469.668764:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509469.668769:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668775:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddca4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668790:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668796:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668802:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668807:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509469.668815:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668821:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668829:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bb300) 00010000:00010000:0.0:1788509469.668832:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509469.668835:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668841:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668851:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668858:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668863:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668868:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ac00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509469.668870:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668876:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.668883:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509469.668885:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509469.668895:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509469.669640:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddcb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509469.669771:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:11166:x1875387774703232:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1515us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509469.669781:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788509469.674446:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509469.674759:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774703488 00000100:00100000:3.0:1788509469.674768:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774703488 00000100:00100000:3.0:1788509469.674874:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788509469.674885:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:11166:x1875387774703488:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788509469.675141:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+33:11166:x1875387774703488:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 257us (701us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788509469.675148:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788509469.721353:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509469.721680:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774703744 00000100:00100000:1.0:1788509469.721691:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774703744 00000100:00100000:1.0:1788509469.721756:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788509469.721765:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+33:11169:x1875387774703744:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509469.721790:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509469.721810:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddcb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530cd expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722266:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722281:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722292:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722304:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722310:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722317:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722431:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722440:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722447:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509469.722458:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788509469.722544:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722552:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722565:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722571:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8e00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509469.722575:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722583:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722595:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:1.0:1788509469.722598:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509469.722603:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722610:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddcc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722632:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722639:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722645:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722649:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509469.722652:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722668:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722677:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bb300) 00010000:00010000:1.0:1788509469.722679:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509469.722682:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722688:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddcc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722730:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddcb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 36 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722743:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 35 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509469.722749:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:1.0:1788509469.722751:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509469.722754:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9c00, rc 0) 00000100:00100000:1.0:1788509469.722818:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:11169:x1875387774703744:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1054us (1474us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788509469.722826:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788509469.729258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509469.729376:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774703872 00000100:00100000:2.0:1788509469.729385:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774703872 00000100:00100000:2.0:1788509469.729434:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788509469.729443:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:11169:x1875387774703872:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788509469.729524:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729542:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729554:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729588:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729594:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729599:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729605:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509469.729609:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729615:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729638:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509469.729641:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788509469.729662:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509469.729668:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509469.729743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:11169:x1875387774703872:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 299us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509469.729749:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788509469.737276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509469.739097:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774704128 00000100:00100000:3.0:1788509469.739110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774704128 00000100:00100000:3.0:1788509469.739176:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788509469.739186:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:11169:x1875387774704128:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788509469.739414:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:11169:x1875387774704128:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 229us (2147us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788509469.739433:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000040:00080000:1.0:1788509470.038736:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788509470.039422:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788509470.193072:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509470.193207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774704384 00000100:00100000:0.0:1788509470.193217:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774704384 00000100:00100000:0.0:1788509470.193297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1788509470.193307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:11201:x1875387774704384:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788509470.193331:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509470.193352:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddce3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.193467:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.193482:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.193495:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509470.193506:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788509470.193632:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddce3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530d4 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.193650:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530d4 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.193672:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509470.193675:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509470.193679:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b000, rc 0) 00000100:00100000:0.0:1788509470.193752:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:11201:x1875387774704384:12345-192.168.203.12@tcp:101:cat.0 Request processed in 446us (688us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788509470.193758:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00080000:2.0:1788509470.193890:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509470.196491:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509470.196660:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774704512 00000100:00100000:0.0:1788509470.196670:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774704512 00000100:00100000:0.0:1788509470.196736:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788509470.196755:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87366300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:2409:x1875387774704512:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509470.196769:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509470.196793:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddcea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530d4 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.196814:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509470.196818:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509470.196879:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87366300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:2409:x1875387774704512:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 126us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509470.196887:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788509470.197649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509470.197722:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774704768 00000100:00100000:2.0:1788509470.197729:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774704768 00000100:00100000:2.0:1788509470.197776:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1788509470.197786:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:11201:x1875387774704768:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:2.0:1788509470.198021:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:11201:x1875387774704768:12345-192.168.203.12@tcp:35:cat.0 Request processed in 236us (373us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788509470.198027:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788509470.291559:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509470.291751:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774705024 00000100:00100000:2.0:1788509470.291761:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774705024 00000100:00100000:2.0:1788509470.291832:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788509470.291843:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:11207:x1875387774705024:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788509470.291865:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509470.291868:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788509470.291894:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddc50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530aa expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.291951:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509470.291972:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509470.291987:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcf8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530db expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.292091:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.292106:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 38 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.292114:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.292144:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 38 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.292158:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 38 pid: 9006 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509470.292171:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796810496:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509470.292275:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8331b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788509470.299776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509470.303691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774705152 00000100:00100000:0.0:1788509470.303807:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774705152 00010000:00010000:0.0:1788509470.303858:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 39 pid: 9006 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509470.303961:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1788509470.303985:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:2407:x1875387774705152:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509470.304000:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509470.304007:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 39 pid: 9006 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.304020:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 39 pid: 9006 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509470.304024:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796810496:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509470.304049:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddcce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530cd expref: 39 pid: 9006 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.304056:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.304065:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509470.304071:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.304084:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.304091:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.304272:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.304273:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509470.304473:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:2407:x1875387774705152:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 489us (4703us total) trans 0 rc 0/0 00010000:00010000:2.0:1788509470.304484:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509470.304485:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000004:00200000:2.0:1788509470.304511:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788509470.304666:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddcf8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.304683:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.304692:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509470.304695:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788509470.304698:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226000, rc 0) 00000100:00100000:2.0:1788509470.304726:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:11207:x1875387774705024:12345-192.168.203.12@tcp:101:dd.0 Request processed in 12885us (13176us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788509470.304747:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788509470.327647:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509470.327735:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774705280 00000100:00100000:0.0:1788509470.327745:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774705280 00000100:00100000:0.0:1788509470.327808:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788509470.327819:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:11207:x1875387774705280:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1788509470.327855:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509470.327874:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530e2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.327943:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.327957:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.327969:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.328076:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.328094:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.328103:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509470.328106:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788509470.328109:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590ac00, rc 0) 00000100:00100000:0.0:1788509470.328173:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:11207:x1875387774705280:12345-192.168.203.12@tcp:101:dd.0 Request processed in 346us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509470.328180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788509470.338470:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509470.343877:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774705536 00000100:00100000:0.0:1788509470.344703:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774705536 00000100:00100000:0.0:1788509470.344895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788509470.345058:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:11207:x1875387774705536:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:0.0:1788509470.346341:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.346369:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.346384:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788509470.346444:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788509470.346472:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b33561bc reply state 0000000088c88946 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.346486:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.346496:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509470.346499:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509470.346505:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788509470.348600:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+42:11207:x1875387774705536:12345-192.168.203.12@tcp:36:dd.0 Request processed in 3532us (10121us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788509470.348630:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000020:00080000:0.0:1788509470.348640:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788509470.616780:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509470.738520:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509470.743172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774705664 00000100:00100000:1.0:1788509470.743194:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774705664 00000100:00100000:1.0:1788509470.743331:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1788509470.743344:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+42:11221:x1875387774705664:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:1.0:1788509470.743376:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509470.743408:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddd22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530e9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.743490:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.743507:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.743534:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.743548:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.744089:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.744100:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.744202:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.744215:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.744242:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.744290:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.744308:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 43 pid: 6520 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509470.744325:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796810624:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509470.744471:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509470.752534:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509470.752683:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774705920 00000100:00100000:2.0:1788509470.752695:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774705920 00000100:00100000:2.0:1788509470.752786:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788509470.752798:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:6179:x1875387774705920:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788509470.753259:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+45:6179:x1875387774705920:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 461us (737us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788509470.753268:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788509470.759973:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796810624:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509470.760022:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509470.762793:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509470.770931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774706048 00000100:00100000:0.0:1788509470.770962:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774706048 00010000:00010000:0.0:1788509470.771039:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 45 pid: 6520 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509470.771098:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788509470.771110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+45:2407:x1875387774706048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509470.771152:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509470.771160:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 45 pid: 6520 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.771176:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 45 pid: 6520 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.771204:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddcff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530db expref: 45 pid: 6520 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.771226:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509470.771231:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.771245:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.771254:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509470.771282:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509470.771365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:2407:x1875387774706048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 258us (8810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509470.771374:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00010000:00010000:1.0:1788509470.772888:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.772943:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509470.773143:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788509470.773149:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509470.773206:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773226:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773260:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773267:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773275:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773282:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509470.773287:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773294:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773311:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:1.0:1788509470.773314:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509470.773320:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773326:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddd29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773341:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773348:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773354:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773365:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509470.773368:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773374:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773383:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bb300) 00010000:00010000:1.0:1788509470.773386:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509470.773389:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773395:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773438:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddd22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e9 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773454:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e9 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509470.773461:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:1.0:1788509470.773463:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509470.773466:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9000, rc 0) 00000100:00100000:1.0:1788509470.774370:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:11221:x1875387774705664:12345-192.168.203.12@tcp:101:stat.0 Request processed in 31020us (35857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509470.774381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788509470.873351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509470.873450:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774706304 00000100:00100000:2.0:1788509470.873463:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774706304 00000100:00100000:2.0:1788509470.873536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1788509470.873550:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:11227:x1875387774706304:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:2.0:1788509470.873654:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509470.873693:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddd37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e9 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.873715:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509470.873722:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509470.874127:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.874146:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.874158:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788509470.874207:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788509470.874232:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d04d1ed3 reply state 000000001fa33480 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.874246:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509470.874252:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509470.874255:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788509470.874258:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788509470.874396:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+45:11227:x1875387774706304:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 848us (1057us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788509470.874405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000020:00080000:2.0:1788509470.874412:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788509471.102344:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509471.102460:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774706432 00000100:00100000:0.0:1788509471.102473:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774706432 00000100:00100000:0.0:1788509471.102601:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1788509471.102631:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+45:11241:x1875387774706432:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:0.0:1788509471.102684:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509471.102711:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddd45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530f0 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.102823:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.102842:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.102856:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.102869:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.102877:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.102884:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103013:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103023:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103031:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509471.103082:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788509471.103094:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509471.103124:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103140:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103150:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103157:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103164:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103171:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509471.103176:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103185:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103199:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509471.103202:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509471.103208:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103216:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310ddd4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103233:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103250:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103257:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103262:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509471.103266:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103273:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103281:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bb300) 00010000:00010000:0.0:1788509471.103284:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509471.103287:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103294:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103325:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddd45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 47 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103340:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 46 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.103349:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509471.103351:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509471.103360:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a600, rc 0) 00000100:00100000:0.0:1788509471.103443:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+46:11241:x1875387774706432:12345-192.168.203.12@tcp:101:stat.0 Request processed in 831us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.103452:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1788509471.215383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509471.216428:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774706688 00000100:00100000:1.0:1788509471.216464:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774706688 00000100:00100000:1.0:1788509471.216545:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1788509471.216557:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+46:11251:x1875387774706688:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509471.216586:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509471.216624:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddd61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530f7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509471.216781:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788509471.216958:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddd61 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f7 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.216975:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:1.0:1788509471.216978:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788509471.216984:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddd61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f7 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.216999:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9200, rc 0) 00000100:00100000:1.0:1788509471.218183:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+47:11251:x1875387774706688:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1619us (2803us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1788509471.218195:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1788509471.222462:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509471.222569:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774706944 00000100:00100000:2.0:1788509471.222598:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774706944 00000100:00100000:2.0:1788509471.222681:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788509471.222693:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+47:11251:x1875387774706944:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788509471.223018:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+48:11251:x1875387774706944:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 326us (568us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788509471.223027:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788509471.310357:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509471.310463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774707200 00000100:00100000:1.0:1788509471.310476:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774707200 00000100:00100000:1.0:1788509471.310564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1788509471.310577:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+48:11257:x1875387774707200:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788509471.310608:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509471.310646:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddd6f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475530fe expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.310800:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.310819:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 49 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.310829:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.310869:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 49 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.310885:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 49 pid: 9006 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509471.310955:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796810752:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509471.311198:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788509471.315065:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509471.315397:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774707328 00000100:00100000:0.0:1788509471.315408:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774707328 00010000:00010000:0.0:1788509471.315467:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 50 pid: 9006 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509471.315516:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1788509471.315527:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+50:2407:x1875387774707328:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509471.315543:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509471.315550:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 50 pid: 9006 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.315565:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 50 pid: 9006 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.315591:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509471.315597:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.315608:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.315626:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.315649:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509471.315743:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+50:2407:x1875387774707328:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 216us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.315751:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00010000:00010000:1.0:1788509471.316988:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddd5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530f0 expref: 49 pid: 9006 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509471.317017:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796810752:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509471.317044:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.317055:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.317517:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509471.317544:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788509471.317736:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddd6f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.317754:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.317763:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:1.0:1788509471.317766:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788509471.317771:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9c00, rc 0) 00000100:00100000:1.0:1788509471.318510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+49:11257:x1875387774707200:12345-192.168.203.12@tcp:101:bash.0 Request processed in 7928us (8159us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788509471.318520:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1788509471.328150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509471.333272:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774707584 00000100:00100000:2.0:1788509471.333292:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774707584 00000100:00100000:2.0:1788509471.333395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1788509471.333409:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+49:11257:x1875387774707584:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788509471.333776:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.333800:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.333814:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788509471.333862:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788509471.333887:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006606e9dc reply state 0000000015cffb97 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.333938:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.333947:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509471.333950:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788509471.333954:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788509471.334081:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+52:11257:x1875387774707584:12345-192.168.203.12@tcp:36:bash.0 Request processed in 673us (5944us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788509471.334107:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000020:00080000:2.0:1788509471.334113:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788509471.339421:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509471.339781:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774707712 00000100:00100000:0.0:1788509471.339794:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774707712 00000100:00100000:0.0:1788509471.339885:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788509471.339927:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+52:11257:x1875387774707712:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509471.339967:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509471.339993:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddd8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553105 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.340118:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.340136:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.340145:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.340378:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.340393:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 53 pid: 6521 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509471.340409:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796810880:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509471.340527:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd922efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509471.347586:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509471.348995:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796810880:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509471.349033:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509471.353567:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774707840 00000100:00100000:2.0:1788509471.353592:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774707840 00010000:00010000:2.0:1788509471.353681:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 54 pid: 6521 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509471.353747:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788509471.353758:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:2408:x1875387774707840:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509471.353778:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509471.353786:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 54 pid: 6521 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.353801:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 54 pid: 6521 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.353830:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddd76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530fe expref: 54 pid: 6521 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.353851:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509471.353857:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.353867:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.353876:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.353983:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509471.354000:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.354009:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509471.354068:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+53:2408:x1875387774707840:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 310us (6496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509471.354076:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000004:00200000:0.0:1788509471.354080:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788509471.354085:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509471.354125:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.354170:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddd8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553105 expref: 53 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.354187:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553105 expref: 52 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.354194:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509471.354197:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509471.354199:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a400, rc 0) 00000100:00100000:0.0:1788509471.354237:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+52:11257:x1875387774707712:12345-192.168.203.12@tcp:101:bash.0 Request processed in 14334us (14822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.354245:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788509471.357062:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509471.357696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774708096 00000100:00100000:2.0:1788509471.357711:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774708096 00000100:00100000:2.0:1788509471.357794:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788509471.357806:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+52:11257:x1875387774708096:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788509471.358264:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+53:11257:x1875387774708096:12345-192.168.203.12@tcp:35:bash.0 Request processed in 457us (1214us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788509471.358274:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788509471.446680:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509471.446711:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796811008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509471.446826:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509471.451161:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796811008 00000100:00100000:1.0:1788509471.451183:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796811008 00000100:00100000:1.0:1788509471.451491:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788509471.451506:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796811008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509471.451559:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509471.451702:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796811008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 199us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509471.451709:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788509471.456247:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796811008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509471.509818:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509471.511536:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774708352 00000100:00100000:1.0:1788509471.511579:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774708352 00000100:00100000:1.0:1788509471.511746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1788509471.511762:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+53:11267:x1875387774708352:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509471.511796:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509471.511826:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddd99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755310c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509471.514018:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788509471.514650:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddd99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755310c expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.514673:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:3.0:1788509471.514677:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788509471.514683:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddd99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755310c expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.514702:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8e00, rc 0) 00000100:00100000:3.0:1788509471.515166:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:11267:x1875387774708352:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 3405us (5359us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788509471.515195:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000001:00080000:1.0:1788509471.525442:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:1.0:1788509471.525514:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788509471.525545:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bcc876dcf00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788509471.525552:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcdb5993d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bcc876dc000 00000020:00080000:1.0:1788509471.525555:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcdb5993000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bcdbd334600 00000100:00100000:1.0:1788509471.525768:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509471.525803:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796811136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788509471.525891:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509471.526046:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796811136 00000100:00100000:1.0:1788509471.526055:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796811136 00000100:00100000:1.0:1788509471.526125:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788509471.526137:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796811136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788509471.526184:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788509471.526229:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9a7d1c, atime: 0x6a9a7d1c, ctime: 0x6a9a7d1c, blocks: 0x8 00010000:00010000:1.0:1788509471.526239:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526259:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1788509471.526264:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509471.526273:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526314:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526326:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526334:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526355:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788509471.526538:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1875387796811136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 404us (647us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788509471.526547:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:1.0:1788509471.526628:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcd87c6f480/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788509471.526635:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796811136:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788509471.526667:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509471.526679:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526688:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509471.526693:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526705:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788509471.526733:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:1.0:1788509471.526743:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526753:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086f18a62/0xe5156b86310ddda7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509471.526775:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509471.526778:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509471.526779:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788509471.526798:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1788509471.526938:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1788509471.531125:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531147:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531156:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531163:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4ac00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509471.531169:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531178:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531419:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8bcd8cb0d800) 00010000:00010000:2.0:1788509471.531423:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509471.531430:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531437:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddbcb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531471:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531478:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531484:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531488:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4a000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509471.531491:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531497:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531505:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509471.531507:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509471.531510:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531516:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddbd2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531548:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531555:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531561:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531566:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590bc00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509471.531569:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531576:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531585:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bb300) 00010000:00010000:2.0:1788509471.531587:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509471.531591:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531597:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddc11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531623:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531630:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531635:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531647:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509471.531713:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531722:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531732:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509471.531734:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509471.531737:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531744:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddd1b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531755:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531761:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531766:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531771:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509471.531774:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531779:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531799:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509471.531802:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509471.531805:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531810:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddd3e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531823:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531829:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531835:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531840:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509471.531842:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531848:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531855:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509471.531858:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509471.531860:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.531866:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddd84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509471.532091:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509471.532202:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774708480 00000100:00100000:0.0:1788509471.532214:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774708480 00000100:00100000:0.0:1788509471.532283:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:0.0:1788509471.532294:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:11267:x1875387774708480:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788509471.532390:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532407:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532428:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532445:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532460:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532466:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532567:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532575:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532582:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509471.532672:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532687:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532693:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532700:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532705:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509471.532708:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532714:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532724:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509471.532727:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509471.532730:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532736:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dddae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532748:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532754:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532766:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532771:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509471.532773:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532779:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bbd00) 00010000:00010000:0.0:1788509471.532788:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509471.532791:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532796:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dddb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532808:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532813:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532819:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532823:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509471.532825:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532840:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532847:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509471.532850:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509471.532853:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.532858:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dddbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509471.532988:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:11267:x1875387774708480:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 694us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.532997:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:0.0:1788509471.542264:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509471.542347:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774708736 00000100:00100000:3.0:1788509471.542360:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774708736 00000100:00100000:3.0:1788509471.542430:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788509471.542443:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:11267:x1875387774708736:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788509471.543060:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:11267:x1875387774708736:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 617us (807us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788509471.543068:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788509471.584580:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509471.586372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774708992 00000100:00100000:2.0:1788509471.586393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774708992 00000100:00100000:2.0:1788509471.586555:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1788509471.586569:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:11270:x1875387774708992:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509471.586603:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509471.586642:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dddc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553113 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.586751:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.586770:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.586784:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.586801:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.586807:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.586813:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587018:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dddd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587029:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587057:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509471.587071:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788509471.587170:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587178:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587185:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587191:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509471.587196:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587205:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587220:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509471.587223:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509471.587229:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587236:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310dddca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587253:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587260:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587272:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587277:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509471.587280:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587286:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587295:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047400) 00010000:00010000:2.0:1788509471.587298:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509471.587301:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587307:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310dddd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587370:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dddc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553113 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587385:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dddd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553113 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.587392:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509471.587394:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509471.587397:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227800, rc 0) 00000100:00100000:2.0:1788509471.587475:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11270:x1875387774708992:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 909us (2910us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788509471.587492:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1788509471.597046:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509471.597224:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774709120 00000100:00100000:0.0:1788509471.597238:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774709120 00000100:00100000:0.0:1788509471.597317:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1788509471.597328:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11270:x1875387774709120:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788509471.597436:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597459:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597475:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597523:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597547:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597554:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597561:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509471.597566:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597574:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597590:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509471.597594:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509471.597600:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.597607:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddde6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509471.598273:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509471.600351:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774709248 00000100:00100000:2.0:1788509471.600369:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774709248 00000100:00100000:2.0:1788509471.600469:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788509471.600482:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:2409:x1875387774709248:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509471.600499:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509471.600531:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310dddd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553113 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.600554:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:2.0:1788509471.600560:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509471.600644:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:2409:x1875387774709248:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 164us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.601106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11270:x1875387774709120:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 3777us (4074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.601117:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1788509471.602177:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788509471.604396:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509471.604747:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774709504 00000100:00100000:2.0:1788509471.604762:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774709504 00000100:00100000:2.0:1788509471.604893:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788509471.605065:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:11270:x1875387774709504:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788509471.605365:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11270:x1875387774709504:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 305us (981us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788509471.605374:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00010000:00010000:2.0:1788509471.638186:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509471.816638:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509471.816730:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774709760 00000100:00100000:3.0:1788509471.816743:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774709760 00000100:00100000:3.0:1788509471.816834:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1788509471.816848:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11288:x1875387774709760:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1788509471.816879:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509471.816957:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310ddded lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755311a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.817133:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dddf4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.817151:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dddf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.817165:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dddf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509471.817186:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788509471.817327:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310ddded lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755311a expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.817351:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dddf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755311a expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.817361:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:3.0:1788509471.817363:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788509471.817368:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030600, rc 0) 00000100:00100000:3.0:1788509471.817453:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11288:x1875387774709760:12345-192.168.203.12@tcp:101:cat.0 Request processed in 609us (828us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788509471.817461:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1788509471.855363:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509471.855621:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774709888 00000100:00100000:0.0:1788509471.855634:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774709888 00000100:00100000:0.0:1788509471.855706:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:0.0:1788509471.855717:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11289:x1875387774709888:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509471.855769:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509471.855795:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553121 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.855887:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dde09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.855951:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dde09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.855967:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dde09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509471.856025:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788509471.856028:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509471.856049:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dde09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.856079:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553121 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.856100:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dde09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553121 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.856110:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509471.856114:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509471.856118:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a000, rc 0) 00000100:00100000:0.0:1788509471.856196:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11289:x1875387774709888:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 481us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.856203:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788509471.866499:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509471.866798:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774710272 00000100:00100000:2.0:1788509471.866812:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774710272 00000100:00100000:2.0:1788509471.866950:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788509471.866963:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11289:x1875387774710272:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788509471.867375:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11289:x1875387774710272:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 412us (887us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788509471.867383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788509471.874358:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509471.875375:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774710400 00000100:00100000:3.0:1788509471.875392:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774710400 00000100:00100000:3.0:1788509471.875487:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1788509471.875500:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11289:x1875387774710400:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:3.0:1788509471.875530:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788509471.875566:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310ddd92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553105 expref: 19 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.875596:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dddf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755311a expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.875624:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310ddc8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530bf expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509471.875653:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:3.0:1788509471.875660:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509471.875741:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11289:x1875387774710400:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 243us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.875749:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788509471.879583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509471.879752:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774710528 00000100:00100000:2.0:1788509471.879765:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774710528 00000100:00100000:2.0:1788509471.879840:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1788509471.879862:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11289:x1875387774710528:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:2.0:1788509471.880311:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.880333:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509471.880348:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788509471.881287:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788509471.881475:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788509471.885310:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788509471.885463:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11289:x1875387774710528:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 5604us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509471.885480:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788509471.910720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509471.910858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774710656 00000100:00100000:0.0:1788509471.910870:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774710656 00000100:00100000:0.0:1788509471.911164:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788509471.911178:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11291:x1875387774710656:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509471.911205:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509471.911231:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dde17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553128 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911317:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911334:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911348:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911365:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911372:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911378:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911464:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911475:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911500:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509471.911555:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788509471.911561:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509471.911663:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911679:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911689:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911696:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911704:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911711:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509471.911716:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911725:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911739:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509471.911743:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509471.911749:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911770:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dde1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911789:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911795:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911801:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911807:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590bc00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509471.911810:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911816:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911825:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bbd00) 00010000:00010000:0.0:1788509471.911827:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509471.911830:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911837:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310dde25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911873:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310dde17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.911889:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509471.912481:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509471.912484:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509471.912488:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590ae00, rc 0) 00000100:00100000:0.0:1788509471.912590:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11291:x1875387774710656:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1406us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.912599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:2.0:1788509471.958281:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509471.958311:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796811264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509471.958401:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509471.958505:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796811264 00000100:00100000:2.0:1788509471.958515:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796811264 00000100:00100000:2.0:1788509471.958590:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788509471.958599:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796811264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788509471.958646:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509471.958697:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796811264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509471.958705:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788509471.958754:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796811264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509471.959068:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796811392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509471.959100:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509471.959682:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796811520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509471.959723:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509471.959849:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796811520 00000100:00100000:3.0:1788509471.959856:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796811520 00000100:00100000:3.0:1788509471.959959:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788509471.959969:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796811520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509471.959998:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509471.960049:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796811520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.960056:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788509471.960101:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796811520:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788509471.960363:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509471.961648:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796811776:0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.961719:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509471.961757:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796812288:0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.961780:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509471.961796:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796812800:0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.961817:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509471.961844:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788509471.961850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796811904:0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.961871:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509471.961960:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796812416:0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.962213:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509471.962266:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796811776 00000100:00100000:3.0:1788509471.962275:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796811776 00000100:00100000:3.0:1788509471.962321:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796812288 00000100:00100000:3.0:1788509471.962324:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796812288 00000100:00100000:3.0:1788509471.962351:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796812800 00000100:00100000:3.0:1788509471.962354:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796812800 00000100:00100000:3.0:1788509471.962364:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796811904 00000100:00100000:3.0:1788509471.962366:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796811904 00000100:00100000:3.0:1788509471.962381:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788509471.962389:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796811776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.962456:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796811776:12345-0@lo:400:kworker.0 Request processed in 67us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.962463:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788509471.962481:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788509471.962487:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796812288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.962516:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796812288:12345-0@lo:400:kworker.0 Request processed in 29us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.962522:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788509471.962533:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788509471.962538:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796812800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.962565:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796812800:12345-0@lo:400:kworker.0 Request processed in 27us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.962570:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788509471.962580:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788509471.962585:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796811904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.962817:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796811648:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.962863:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509471.962891:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796812160:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.962961:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509471.962973:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796812672:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.963213:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509471.963233:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788509471.963240:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796812032:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.963265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509471.963343:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796811904:12345-0@lo:400:kworker.0 Request processed in 757us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.963351:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788509471.963366:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796812160 00000100:00100000:3.0:1788509471.963371:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796812160 00000100:00100000:3.0:1788509471.963397:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796812672 00000100:00100000:3.0:1788509471.963399:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796812672 00000100:00100000:3.0:1788509471.963413:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788509471.963418:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796812160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.963448:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796812160:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.963453:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788509471.963463:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788509471.963468:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796812672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.963493:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796812672:12345-0@lo:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.963499:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:3.0:1788509471.963518:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509471.963523:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509471.963569:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796811904:0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.963582:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796811776:0@lo:400:kworker.0 00010000:00080000:3.0:1788509471.963598:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd84a3d500 x1875387796812288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509471.963628:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796812288:0@lo:400:kworker.0 00010000:00080000:3.0:1788509471.963642:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd84a3ca80 x1875387796812800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509471.963664:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796812800:0@lo:400:kworker.0 00000100:00100000:0.0:1788509471.963801:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796811648 00000100:00100000:0.0:1788509471.963805:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796811648 00000100:00100000:0.0:1788509471.963850:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788509471.963858:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796811648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509471.963922:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796811648:12345-0@lo:400:kworker.0 Request processed in 42us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.963929:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788509471.964031:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796812416 00000100:00100000:0.0:1788509471.964036:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796812416 00000100:00100000:0.0:1788509471.964075:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788509471.964082:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796812416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509471.964118:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796812416:12345-0@lo:400:kworker.0 Request processed in 37us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509471.964125:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788509471.964140:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509471.964480:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796812416:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.967210:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796812544:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.967951:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509471.968132:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796811648:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.968169:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796812160:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.968183:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796812672:0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.968315:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796812544 00000100:00100000:3.0:1788509471.968324:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796812544 00000100:00100000:3.0:1788509471.968396:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788509471.968406:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796812544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.968477:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796812544:12345-0@lo:400:kworker.0 Request processed in 72us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.968485:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788509471.968815:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796811392 00000100:00100000:1.0:1788509471.968821:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796811392 00000100:00100000:1.0:1788509471.968870:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796812032 00000100:00100000:1.0:1788509471.968873:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796812032 00000100:00100000:1.0:1788509471.968887:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788509471.968893:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796811392:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509471.969138:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788509471.969147:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796812032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509471.969193:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796812032:12345-0@lo:400:kworker.0 Request processed in 48us (5927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509471.969200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000004:00000024:1.0:1788509471.969264:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788509471.969323:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796811392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 429us (10222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509471.969329:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788509471.969409:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796811392:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788509471.969472:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509471.969505:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796812032:0@lo:400:kworker.0 00000100:00100000:2.0:1788509471.969517:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796812544:0@lo:400:kworker.0 00000040:00080000:1.0:1788509472.086321:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788509472.086333:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788509472.086400:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788509472.086414:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788509472.086971:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796812928:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788509472.087106:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509472.099376:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509472.099524:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796812928:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788509472.099860:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774710784 00000100:00100000:3.0:1788509472.099870:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774710784 00000100:00080000:2.0:1788509472.100048:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509472.101052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788509472.101074:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11302:x1875387774710784:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788509472.101117:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788509472.101284:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11302:x1875387774710784:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 219us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.101292:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:0.0:1788509472.112352:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509472.113709:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774710912 00000100:00100000:1.0:1788509472.113730:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774710912 00000100:00100000:1.0:1788509472.113832:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788509472.113845:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11302:x1875387774710912:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788509472.113962:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.113983:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.113997:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114163:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114187:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114216:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114256:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114266:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114274:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509472.114327:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788509472.114333:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509472.114355:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114369:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114376:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114382:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114389:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509472.114393:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114401:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114424:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:1.0:1788509472.114427:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509472.114432:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114439:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310dde33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114455:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114462:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114468:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114473:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509472.114476:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114482:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114490:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.114493:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509472.114496:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114501:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114528:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114535:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114540:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114545:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509472.114548:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114554:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114561:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:1.0:1788509472.114564:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509472.114567:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.114573:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.114683:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11302:x1875387774710912:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 838us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.114694:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788509472.126297:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.126497:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774711168 00000100:00100000:3.0:1788509472.126514:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774711168 00000100:00100000:3.0:1788509472.126655:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1788509472.126671:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11302:x1875387774711168:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509472.126700:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509472.126728:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dde48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755312f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.126882:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.126922:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.126938:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509472.126952:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788509472.127049:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127057:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127064:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127071:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509472.127076:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127199:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127226:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:3.0:1788509472.127229:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788509472.127235:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127313:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dde48 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755312f expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127395:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:3.0:1788509472.127399:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788509472.127404:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dde48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755312f expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.127417:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030600, rc 0) 00000100:00100000:3.0:1788509472.127506:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11302:x1875387774711168:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 839us (1217us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788509472.127514:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:0.0:1788509472.135993:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.139733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774711296 00000100:00100000:3.0:1788509472.139755:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774711296 00000100:00100000:3.0:1788509472.139844:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788509472.139858:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11302:x1875387774711296:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788509472.139923:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788509472.140315:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11302:x1875387774711296:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 458us (4334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509472.140377:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1788509472.158951:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.159075:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774711552 00000100:00100000:3.0:1788509472.159088:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774711552 00000100:00100000:3.0:1788509472.159180:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1788509472.159201:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11302:x1875387774711552:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509472.159229:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509472.159233:0:9006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788509472.159278:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310dde09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553121 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.159301:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:3.0:1788509472.159306:0:9006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509472.159323:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dde5d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553136 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788509472.160521:0:9006:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788509472.163641:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.163762:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.163779:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.163866:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310dde5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553136 expref: 20 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.163887:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553136 expref: 19 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.164383:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcd8cb0da00) 00010000:00010000:3.0:1788509472.164388:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788509472.164400:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030800, rc 0) 00000100:00100000:0.0:1788509472.165018:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11302:x1875387774711552:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 5813us (6073us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788509472.165030:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1788509472.168467:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.168534:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774711808 00000100:00100000:3.0:1788509472.168546:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774711808 00000100:00100000:3.0:1788509472.168624:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1788509472.168636:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11302:x1875387774711808:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788509472.168717:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509472.168752:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310dde64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553136 expref: 19 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.168773:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcd8cb0da00) 00010000:00010000:3.0:1788509472.168785:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509472.168815:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.168832:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.168844:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171336:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171429:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171444:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171567:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171590:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171598:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171605:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509472.171621:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171629:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171700:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:3.0:1788509472.171704:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509472.171709:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171716:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310dde72 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171734:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171741:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171747:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171753:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509472.171780:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171788:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171798:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x386cceb3 (ffff8bcd8cb0d200) 00010000:00010000:3.0:1788509472.171801:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509472.171805:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.171810:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310dde79 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x386cceb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509472.171946:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11302:x1875387774711808:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 3306us (3488us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788509472.171956:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1788509472.175105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509472.175187:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774711936 00000100:00100000:1.0:1788509472.175219:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774711936 00000100:00100000:1.0:1788509472.175326:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1788509472.175340:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11302:x1875387774711936:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509472.175368:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509472.175400:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755313d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.175447:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.175464:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.175479:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.176079:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.176104:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.176114:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.176117:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788509472.176121:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9c00, rc 0) 00000100:00100000:1.0:1788509472.176307:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11302:x1875387774711936:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 969us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.176316:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788509472.190825:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.191248:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774712192 00000100:00100000:3.0:1788509472.191263:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774712192 00000100:00100000:3.0:1788509472.191333:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:3.0:1788509472.191359:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11302:x1875387774712192:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788509472.191442:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.191632:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.191656:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788509472.192002:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788509472.192013:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369353114201ns, next at 370353111689ns, rc = 0 00000004:00010000:3.0:1788509472.192109:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f70a4777 reply state 00000000f76f05b0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.192121:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.192128:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:3.0:1788509472.192131:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788509472.192134:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788509472.192245:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:11302:x1875387774712192:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 902us (1433us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788509472.192252:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1788509472.200757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509472.201064:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774712320 00000100:00100000:2.0:1788509472.201079:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774712320 00000100:00100000:1.0:1788509472.201244:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1788509472.201267:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:11302:x1875387774712320:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509472.201302:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509472.201332:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553144 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.201414:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 22 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.201434:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 22 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.201459:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.201462:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788509472.201468:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8400, rc 0) 00000100:00100000:1.0:1788509472.201667:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11302:x1875387774712320:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 404us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.201676:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1788509472.209203:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509472.209289:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774712448 00000100:00100000:1.0:1788509472.209301:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774712448 00000100:00100000:1.0:1788509472.209356:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788509472.209367:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875387774712448:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788509472.209410:0:8756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:1.0:1788509472.209453:0:8756:0:(genops.c:1385:class_connect()) connect: client d1c7a223-cc58-4f2c-be22-e37eba96eeae, cookie 0xe5156b86310dde9c 00002000:00100000:1.0:1788509472.209468:0:8756:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d1c7a223-cc58-4f2c-be22-e37eba96eeae/ffff8bcc867ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788509472.209492:0:8756:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788509472.209683:0:8756:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788509472.209731:0:8756:0:(import.c:65:import_set_state_nolock()) ffff8bcc867ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509472.211103:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2406:x1875387774712448:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 Request processed in 1727us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.211119:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1788509472.214862:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.215268:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774712576 00000100:00100000:3.0:1788509472.215282:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774712576 00000100:00100000:3.0:1788509472.215395:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788509472.215406:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:0:x1875387774712576:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788509472.216192:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788509472.218509:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1788509472.218522:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000100:00100000:0.0:1788509472.218737:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:0:x1875387774712576:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 3329us (3884us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788509472.218748:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788509472.225017:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509472.225079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774712832 00000100:00100000:2.0:1788509472.225094:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774712832 00000100:00100000:2.0:1788509472.225160:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788509472.225170:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11302:x1875387774712832:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788509472.225414:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:11302:x1875387774712832:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 245us (410us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788509472.225422:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788509472.229248:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.229334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774713088 00000100:00100000:3.0:1788509472.229347:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774713088 00000100:00100000:3.0:1788509472.229418:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:3.0:1788509472.229429:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:11302:x1875387774713088:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788509472.229566:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:11302:x1875387774713088:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 139us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509472.229592:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:3.0:1788509472.236242:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509472.236384:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774713216 00000100:00100000:1.0:1788509472.236395:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774713216 00000100:00100000:1.0:1788509472.236470:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788509472.236481:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:11302:x1875387774713216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509472.236509:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509472.236533:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddea3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755314b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.236630:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddeaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.236656:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddeaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.236672:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddeaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509472.236731:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509472.236755:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddeaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.237071:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddea3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755314b expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.237094:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddeaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755314b expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.237126:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.237129:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788509472.237134:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9000, rc 0) 00000100:00100000:1.0:1788509472.237201:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:11302:x1875387774713216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 721us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.237209:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1788509472.242203:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.243059:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774713344 00000100:00100000:3.0:1788509472.243074:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774713344 00000100:00100000:3.0:1788509472.243159:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788509472.243172:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774713344:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509472.243194:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509472.243221:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553152 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509472.243255:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a7d1f, blocks: 0x0 00010000:00010000:3.0:1788509472.243282:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1788509472.243288:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509472.243298:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.243322:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.243338:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4ac00, rc 0) 00000100:00100000:3.0:1788509472.243420:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774713344:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 250us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509472.243427:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1788509472.246316:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.246543:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774713600 00000100:00100000:3.0:1788509472.246557:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774713600 00000100:00100000:3.0:1788509472.246667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:3.0:1788509472.246679:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:11302:x1875387774713600:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788509472.246832:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:11302:x1875387774713600:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 155us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509472.246840:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1788509472.253565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.253886:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774713728 00000100:00100000:3.0:1788509472.253934:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774713728 00000100:00100000:3.0:1788509472.254008:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1788509472.254021:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:11302:x1875387774713728:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509472.254047:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509472.254071:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553159 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.254117:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.254127:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509472.254132:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509472.254137:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.254181:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.254198:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 7 pid: 8437 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509472.254242:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1875387796813056:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509472.254363:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509472.256545:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1875387796813056:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509472.256589:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.256621:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4ae00, rc 0) 00000100:00100000:3.0:1788509472.256695:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:11302:x1875387774713728:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2676us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509472.256705:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788509472.265161:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.271249:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774713856 00000100:00100000:3.0:1788509472.271273:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774713856 00010000:00010000:2.0:1788509472.272063:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 7 pid: 8437 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509472.272155:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788509472.272168:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774713856:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509472.272189:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509472.272217:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 7 pid: 8437 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.272233:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 7 pid: 8437 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.272271:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc853664/0xe5156b86310ddeb1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553152 expref: 7 pid: 8437 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.272294:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509472.272299:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509472.272310:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.272321:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.272369:0:7472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509472.272387:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a21f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7472:1875387796813184:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788509472.272515:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8331b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509472.277734:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a21f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7472:1875387796813184:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788509472.277776:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509472.277856:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774713856:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5690us (12709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.277869:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788509472.285886:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.286135:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774713984 00000100:00100000:3.0:1788509472.286149:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774713984 00002000:00100000:3.0:1788509472.286209:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8bcd87c6df80 x1875387774713984/t0(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:553/0 lens 504/0 e 0 to 0 dl 1788509483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788509472.286222:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcd87c6df80 with x1875387774713984 ext(0->8) 00002000:00010000:3.0:1788509472.286227:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcd87c6df80 00000100:00100000:3.0:1788509472.286260:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788509472.286270:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774713984:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788509472.295241:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774713984:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 8961us (9359us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788509472.295255:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:3.0:1788509472.295283:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8bcd87c6df80 x1875387774713984/t4294967303(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:553/0 lens 504/448 e 0 to 0 dl 1788509483 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788509472.295293:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcd87c6df80 with x1875387774713984 ext(0->8) 00002000:00010000:3.0:1788509472.295300:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcd87c6df80 00000100:00100000:0.0:1788509472.298873:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509472.299028:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774714112 00000100:00100000:1.0:1788509472.299041:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774714112 00000100:00100000:1.0:1788509472.299123:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1788509472.299135:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:11302:x1875387774714112:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788509472.311621:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788509472.311648:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788509472.311680:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788509472.311823:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796813312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788509472.311937:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509472.312117:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796813312 00000100:00100000:3.0:1788509472.312126:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796813312 00000100:00100000:3.0:1788509472.312181:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788509472.312191:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796813312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788509472.312348:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788509472.312353:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788509471 00002000:00010000:3.0:1788509472.312356:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788509472.312358:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788509471 -> 1788509471 00002000:00010000:3.0:1788509472.312360:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788509472.312410:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796813312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (472us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788509472.312418:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1788509472.312465:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcd84a3f100/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788509472.312472:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796813312:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1788509472.312589:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788509472.312604:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1788509472.312693:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.312707:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.312716:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.312724:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4a000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509472.312747:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.312757:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.312776:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.312780:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788509472.312786:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.312793:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310dde8e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.313153:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:11302:x1875387774714112:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 13849us (14124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.313163:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:0.0:1788509472.317820:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509472.317868:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774714240 00000100:00100000:0.0:1788509472.317881:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774714240 00000100:00100000:0.0:1788509472.317980:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788509472.319366:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2409:x1875387774714240:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788509472.331588:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788509472.331603:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788509472.336226:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2409:x1875387774714240:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 16858us (18404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509472.336245:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788509472.342591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509472.343125:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774714496 00000100:00100000:1.0:1788509472.343138:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774714496 00000100:00100000:1.0:1788509472.343390:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788509472.343405:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:11302:x1875387774714496:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788509472.343481:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509472.343519:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddeaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755314b expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.343544:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.343550:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509472.343594:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.343643:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.343656:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509472.343861:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c3fb4da reply state 000000000a9d3c8c transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.343876:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.343883:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.343886:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509472.343889:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788509472.344171:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11302:x1875387774714496:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 768us (1594us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788509472.344179:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:0.0:1788509472.349405:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.349619:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774714624 00000100:00100000:3.0:1788509472.349633:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774714624 00000100:00100000:3.0:1788509472.349726:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1788509472.349742:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774714624:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788509472.350472:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788509472.350478:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788509471 -> 1788509470 00002000:00010000:3.0:1788509472.350482:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788509468 00002000:00010000:3.0:1788509472.350484:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788509471 -> 1788509470 00002000:00010000:3.0:1788509472.350486:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788509472.350576:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774714624:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 836us (1796us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788509472.350586:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788509472.365428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.365573:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774714880 00000100:00100000:3.0:1788509472.365592:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774714880 00000100:00100000:3.0:1788509472.365682:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1788509472.365695:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:11302:x1875387774714880:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788509472.366014:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.366036:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.366048:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.366095:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.366110:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 15 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509472.366387:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796813440:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509472.366652:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509472.370235:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796813440:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509472.370284:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509472.371588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509472.371637:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774715008 00000100:00100000:2.0:1788509472.371645:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774715008 00010000:00010000:2.0:1788509472.371683:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 16 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509472.371721:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788509472.371731:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:2408:x1875387774715008:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509472.371746:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509472.371753:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 16 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.371766:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 16 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.371788:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310dde87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755313d expref: 16 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.371806:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:2.0:1788509472.371822:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.371832:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.371839:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.371872:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509472.371969:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:2408:x1875387774715008:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 238us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509472.371977:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00010000:00010000:0.0:1788509472.372565:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.372584:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.372648:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.372665:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.372672:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.372678:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4b800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509472.372683:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.372692:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.372708:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:0.0:1788509472.372711:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788509472.372716:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.372722:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddec6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509472.372819:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:11302:x1875387774714880:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 7122us (7396us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788509472.372830:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788509472.380534:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509472.381508:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774715136 00000100:00100000:1.0:1788509472.381520:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774715136 00000100:00100000:1.0:1788509472.381597:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788509472.381619:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774715136:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788509472.381667:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.381688:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.381718:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509472.381722:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509472.381728:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.381770:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.381783:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 7 pid: 8438 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.381798:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1875387796813568:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509472.381887:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509472.393126:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1875387796813568:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509472.393146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1788509472.393191:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509472.393470:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774715264 00000100:00100000:0.0:1788509472.393480:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774715264 00010000:00010000:0.0:1788509472.393656:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 8 pid: 8438 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509472.393710:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788509472.393736:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774715264:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509472.393757:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509472.393782:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 8 pid: 8438 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.393797:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 8 pid: 8438 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.393824:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031fc9cd6/0xe5156b86310ddeb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553159 expref: 8 pid: 8438 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.393844:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788509472.393849:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788509472.393855:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.393867:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.393931:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509472.394204:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.394215:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.394239:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.394247:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.394265:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.394272:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8e00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509472.394278:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.394289:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.394302:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509472.394310:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88e0ad7/0xe5156b86310ddecd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509472.394410:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774715136:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 12802us (13884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509472.394420:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788509472.394625:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774715264:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 890us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509472.394633:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788509472.405919:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509472.406225:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774715520 00000100:00100000:0.0:1788509472.406242:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774715520 00000100:00100000:0.0:1788509472.406321:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:0.0:1788509472.406334:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:11302:x1875387774715520:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788509472.406461:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.406484:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.406495:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.406541:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.406557:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 14 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509472.406574:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d79500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796813696:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509472.406688:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd812ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1788509472.409217:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d79500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796813696:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509472.409266:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.430515:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509472.434799:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774715648 00000100:00100000:0.0:1788509472.435080:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774715648 00010000:00010000:0.0:1788509472.435147:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 15 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509472.435451:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788509472.435466:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:2407:x1875387774715648:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509472.435487:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509472.435495:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 15 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.435531:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 15 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.435563:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310ddd14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475530e2 expref: 15 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.435585:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:0.0:1788509472.435591:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.435614:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.435625:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.435674:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509472.435764:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:2407:x1875387774715648:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 301us (5255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509472.435773:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00010000:00010000:3.0:1788509472.435884:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.435894:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.436164:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.436185:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 14 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.436195:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.436246:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 14 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.436272:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 14 pid: 9006 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509472.436289:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796813824:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509472.436385:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788509472.460800:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509472.461126:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774715776 00000100:00100000:0.0:1788509472.461140:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774715776 00010000:00010000:0.0:1788509472.461193:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 15 pid: 9006 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509472.461252:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788509472.461264:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:2408:x1875387774715776:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509472.461498:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509472.461508:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 15 pid: 9006 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.461525:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 15 pid: 9006 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.461555:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:0.0:1788509472.461561:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.461573:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.461583:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509472.461619:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509472.461704:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:2408:x1875387774715776:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 442us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509472.461713:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00010000:00010000:1.0:1788509472.461969:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310dde95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553144 expref: 14 pid: 9006 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.461994:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796813824:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509472.462024:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.462034:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.462070:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788509472.462193:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788509472.462306:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788509472.462344:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788509472.462538:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875387796813952:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788509472.462601:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509472.462664:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509472.464197:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796813952 00000100:00100000:0.0:1788509472.464272:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796813952 00000100:00100000:0.0:1788509472.464348:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788509472.464361:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1875387796813952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788509472.464539:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1875387796813952:12345-0@lo:1000:mdt00_002.0 Request processed in 180us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509472.464547:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788509472.464804:0:6522:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788509472.464814:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcd84a3f100, transno 4294967304 00000100:00100000:1.0:1788509472.464828:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875387796813952:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788509472.465015:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1788509472.465193:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875387796814080:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788509472.465258:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509472.465300:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509472.465754:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796814080 00000100:00100000:3.0:1788509472.465766:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796814080 00000100:00100000:3.0:1788509472.465836:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788509472.465846:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1875387796814080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788509472.466111:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1875387796814080:12345-0@lo:1000:mdt00_002.0 Request processed in 267us (853us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788509472.466308:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875387796814080:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788509472.466369:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466382:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466390:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466396:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509472.466402:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466434:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466453:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.466457:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788509472.466463:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466470:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddedb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466507:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466513:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466519:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466524:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509472.466527:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466533:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466542:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:1.0:1788509472.466545:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788509472.466555:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466571:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310dde10 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466599:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466622:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509472.466636:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00010000:1.0:1788509472.466637:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466679:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.466698:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 17 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.466713:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796814208:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509472.466803:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509472.471699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509472.471738:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774715904 00000100:00100000:1.0:1788509472.471747:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774715904 00010000:00010000:1.0:1788509472.471788:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 18 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.471828:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:1.0:1788509472.471839:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2407:x1875387774715904:12345-192.168.203.12@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788509472.473035:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796814336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509472.473137:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509472.473210:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796814336 00000100:00100000:3.0:1788509472.473228:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796814336 00000100:00100000:3.0:1788509472.473283:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788509472.473294:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796814336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509472.473333:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788509472.473384:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796814336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509472.473392:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788509472.473452:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796814336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788509472.476037:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509472.476143:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 18 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476169:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 18 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476196:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:1.0:1788509472.476201:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476211:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476219:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476250:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509472.476320:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2407:x1875387774715904:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4481us (4629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509472.476337:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00010000:00010000:1.0:1788509472.476741:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310dde2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553128 expref: 17 pid: 6521 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.476760:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796814208:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509472.476786:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476795:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476816:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476827:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476834:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476841:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476848:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509472.476854:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476862:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476873:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:1.0:1788509472.476877:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509472.476881:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476887:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddee2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.476921:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.477170:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.477183:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.477188:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509472.477191:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.477197:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.477204:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bb800) 00010000:00010000:1.0:1788509472.477207:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788509472.477210:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.477216:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310dded4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509472.477445:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11302:x1875387774715520:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 71112us (71549us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788509472.477456:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000020:00080000:1.0:1788509472.477461:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788509472.477886:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788509472.477891:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788509472.477947:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788509472.477954:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788509472.479133:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509472.479150:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796814464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509472.479220:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509472.479277:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796814464 00000100:00100000:3.0:1788509472.479286:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796814464 00000100:00100000:3.0:1788509472.479327:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788509472.479335:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796814464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509472.480163:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788509472.480247:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796814464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 911us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509472.480255:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788509472.480472:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796814464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509472.482809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509472.482946:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774716160 00000100:00100000:3.0:1788509472.482956:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774716160 00000100:00100000:3.0:1788509472.483024:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788509472.483039:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11302:x1875387774716160:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788509472.484970:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788509472.485012:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788509472.485126:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.485144:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.485154:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.485163:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.485170:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.485176:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509472.485207:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788509472.485312:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11302:x1875387774716160:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 2276us (2510us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788509472.485321:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000020:00080000:3.0:1788509472.485326:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788509472.486581:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509472.486592:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.486601:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4b800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509472.486626:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.486635:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.486650:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:1.0:1788509472.486653:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788509472.486657:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.486664:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddee9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509472.486679:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509472.486681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509472.486683:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509472.662319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788509472.937654:0:14210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509472.937667:0:14210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509472.937694:0:14210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788509472.937701:0:14210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788509473.044255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.044300:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.044336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.044367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.044395:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774716672 00000100:00100000:2.0:1788509473.044417:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774716672 00000100:00100000:2.0:1788509473.044468:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:2.0:1788509473.044479:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774716672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509473.044549:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774716672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509473.044557:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:0.0:1788509473.044760:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774716416 00000100:00100000:0.0:1788509473.044765:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774716416 00000100:00100000:0.0:1788509473.044817:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774716928 00000100:00100000:0.0:1788509473.044821:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774716928 00000100:00100000:0.0:1788509473.044852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 285 00000100:00100000:0.0:1788509473.044860:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2408:x1875387774716416:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509473.044894:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2408:x1875387774716416:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509473.044929:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 285 00000100:00100000:0.0:1788509473.044943:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 286 00000100:00100000:0.0:1788509473.044949:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774716928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509473.044988:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774716928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509473.044994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 286 00000100:00100000:3.0:1788509473.045244:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774716288 00000100:00100000:3.0:1788509473.045249:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774716288 00000100:00100000:3.0:1788509473.045289:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 379 00000100:00100000:3.0:1788509473.045297:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2407:x1875387774716288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509473.045326:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2407:x1875387774716288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509473.045332:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 379 00000100:00080000:2.0:1788509473.045545:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509473.049934:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.049996:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509473.050012:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774716544 00000100:00100000:0.0:1788509473.050025:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774716544 00000100:00100000:3.0:1788509473.050039:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.050081:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774716800 00000100:00100000:3.0:1788509473.050089:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774716800 00000100:00100000:0.0:1788509473.050100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774717056 00000100:00100000:0.0:1788509473.050108:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774717056 00000100:00100000:0.0:1788509473.050157:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 287 00000100:00100000:0.0:1788509473.050170:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774716544:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509473.050188:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1788509473.050202:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774716800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509473.050286:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774716800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509473.050295:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:0.0:1788509473.051310:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774716544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1138us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509473.051322:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 287 00000100:00100000:0.0:1788509473.051363:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00100000:0.0:1788509473.051373:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774717056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509473.051413:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774717056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509473.051420:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00080000:0.0:1788509473.051442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509473.051447:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509473.088930:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.089171:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774717312 00000100:00100000:2.0:1788509473.089185:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774717312 00000100:00100000:2.0:1788509473.089245:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1788509473.089256:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:11312:x1875387774717312:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509473.089277:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509473.089298:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddef0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553160 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.089408:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddef7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.089423:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.089438:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509473.089451:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788509473.089552:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddef0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553160 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.089569:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddef7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553160 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.089593:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509473.089596:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788509473.089599:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227200, rc 0) 00000100:00100000:2.0:1788509473.089691:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:11312:x1875387774717312:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 437us (801us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788509473.089699:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1788509473.097267:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509473.097376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774717440 00000100:00100000:0.0:1788509473.097387:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774717440 00000100:00100000:0.0:1788509473.097490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1788509473.098466:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:11312:x1875387774717440:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788509473.099070:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099089:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099103:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099118:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099124:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099130:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099285:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099293:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099299:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509473.099341:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099351:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099356:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099363:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099368:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509473.099372:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099379:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099390:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509473.099393:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509473.099397:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099409:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310ddf05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099424:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099430:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099435:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099440:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509473.099442:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099447:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099455:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc865bb400) 00010000:00010000:0.0:1788509473.099457:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509473.099460:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099465:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099479:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099484:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099497:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099858:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509473.099864:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099874:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099891:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc865bbf00) 00010000:00010000:0.0:1788509473.099894:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509473.099934:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.099942:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509473.100334:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:11312:x1875387774717440:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 2831us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509473.100344:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1788509473.151698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509473.151854:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774717696 00000100:00100000:1.0:1788509473.151870:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774717696 00000100:00100000:1.0:1788509473.151974:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:1.0:1788509473.151988:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:11315:x1875387774717696:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509473.152017:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509473.152047:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddf1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553167 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.152139:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.152158:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.152173:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.152200:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.152209:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.152217:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.153964:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.153990:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.154005:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509473.154026:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788509473.154156:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.154165:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.154173:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.154181:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509473.154187:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.154212:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155705:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:1.0:1788509473.155715:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509473.155727:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155739:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310ddf21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155765:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155774:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155782:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155788:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509473.155793:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155801:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155816:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcc8761e700) 00010000:00010000:1.0:1788509473.155819:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509473.155822:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155851:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155947:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310ddf1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155964:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.155972:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:1.0:1788509473.155974:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509473.155977:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8e00, rc 0) 00000100:00100000:1.0:1788509473.156221:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11315:x1875387774717696:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 4233us (4530us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788509473.156239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:1.0:1788509473.162941:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.163061:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774717824 00000100:00100000:2.0:1788509473.163077:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774717824 00000100:00100000:2.0:1788509473.163143:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1788509473.163153:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11315:x1875387774717824:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788509473.163287:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163303:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163315:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163347:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163353:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163360:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163377:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509473.163382:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163390:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163402:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:2.0:1788509473.163405:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788509473.163410:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.163416:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310ddf3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509473.163508:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11315:x1875387774717824:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 356us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509473.163517:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:3.0:1788509473.167023:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509473.167259:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774718080 00000100:00100000:1.0:1788509473.167272:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774718080 00000100:00100000:1.0:1788509473.167491:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788509473.167505:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11315:x1875387774718080:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509473.167856:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:11315:x1875387774718080:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 353us (843us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788509473.167867:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788509473.206578:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509473.208925:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774718336 00000100:00100000:0.0:1788509473.208941:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774718336 00000100:00100000:0.0:1788509473.209017:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:0.0:1788509473.209027:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:10841:x1875387774718336:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509473.209052:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509473.209072:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755316e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.209216:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.209232:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.209241:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.209275:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.209289:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 24 pid: 6520 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509473.209304:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796814592:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509473.209399:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82eda000 going to sleep for 11 seconds 00000100:00100000:2.0:1788509473.219578:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.220444:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774718464 00000100:00100000:3.0:1788509473.220468:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774718464 00010000:00010000:3.0:1788509473.220521:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 25 pid: 6520 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509473.220811:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1788509473.220823:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:2407:x1875387774718464:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509473.220842:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509473.220851:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 25 pid: 6520 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.220867:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 25 pid: 6520 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.220915:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:3.0:1788509473.220922:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.220934:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.220944:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.220968:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509473.221036:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:2407:x1875387774718464:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 216us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509473.221045:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:0.0:1788509473.225167:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310ddf2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553167 expref: 24 pid: 6520 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509473.225195:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796814592:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509473.225226:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.225237:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.225259:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509473.225286:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788509473.225459:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310ddf44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.225477:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.225488:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:0.0:1788509473.225491:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788509473.225495:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b000, rc 0) 00000100:00100000:0.0:1788509473.225630:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:10841:x1875387774718336:12345-192.168.203.12@tcp:101:bash.0 Request processed in 16603us (19065us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788509473.225640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788509473.235770:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.235880:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774718592 00000100:00100000:3.0:1788509473.235895:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774718592 00000100:00100000:3.0:1788509473.236014:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:3.0:1788509473.236025:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:10841:x1875387774718592:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788509473.236057:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509473.236084:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553175 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.236129:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddf60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.236147:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddf60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.236162:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddf60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.236299:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553175 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.236324:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddf60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553175 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.236335:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:3.0:1788509473.236339:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788509473.236342:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4b800, rc 0) 00000100:00100000:3.0:1788509473.236419:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:10841:x1875387774718592:12345-192.168.203.12@tcp:101:bash.0 Request processed in 395us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509473.236428:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1788509473.247775:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509473.247893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774718848 00000100:00100000:1.0:1788509473.247959:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774718848 00000100:00100000:1.0:1788509473.248022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1788509473.248048:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:10841:x1875387774718848:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:1.0:1788509473.248317:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.248336:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.248348:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788509473.248406:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788509473.248432:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9c98e9e reply state 0000000005a36a3c transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.248446:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.248454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:1.0:1788509473.248457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509473.248461:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788509473.248512:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788509473.248631:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:10841:x1875387774718848:12345-192.168.203.12@tcp:36:bash.0 Request processed in 584us (875us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788509473.248637:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000020:00080000:1.0:1788509473.248642:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788509473.253336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.253635:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774718976 00000100:00100000:3.0:1788509473.253648:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774718976 00000100:00100000:3.0:1788509473.253744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:3.0:1788509473.253757:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:10841:x1875387774718976:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788509473.253788:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509473.253816:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddf6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755317c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.253918:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddf6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755317c expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.254058:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddf6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755317c expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.254086:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:3.0:1788509473.254089:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788509473.254094:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc1f4a000, rc 0) 00000100:00100000:3.0:1788509473.259290:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:10841:x1875387774718976:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5516us (5948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509473.259309:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:3.0:1788509473.262438:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.262726:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774719104 00000100:00100000:2.0:1788509473.262739:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774719104 00000100:00100000:2.0:1788509473.262842:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1788509473.262855:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:10841:x1875387774719104:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509473.262878:0:8756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509473.262952:0:8756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553183 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509473.263009:0:8756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9a7d1e, atime: 0x6a9a7d1c, ctime: 0x6a9a7d1e, blocks: 0x8 00010000:00010000:2.0:1788509473.263040:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1788509473.263046:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509473.263057:0:8756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 7 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.263084:0:8756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 7 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.263099:0:8756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226200, rc 0) 00000100:00100000:2.0:1788509473.263173:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:10841:x1875387774719104:12345-192.168.203.12@tcp:101:bash.0 Request processed in 321us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509473.263181:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1788509473.266170:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509473.266290:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774719232 00000100:00100000:1.0:1788509473.266303:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774719232 00002000:00010000:1.0:1788509473.266364:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788509473.266370:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcdb7a22300 with x1875387774719232 ext(0->18446744073709551615) 00002000:00010000:1.0:1788509473.266385:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcdb7a22300. 00000100:00100000:1.0:1788509473.266504:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788509473.266527:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774719232:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:1.0:1788509473.267149:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788509473.267154:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788509470 -> 1788509472 00002000:00010000:1.0:1788509473.267158:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788509468 -> 1788509468 00002000:00010000:1.0:1788509473.267160:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788509470 -> 1788509472 00002000:00010000:1.0:1788509473.267162:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788509473.267239:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774719232:12345-192.168.203.12@tcp:10:bash.0 Request processed in 714us (1084us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788509473.267248:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00010000:1.0:1788509473.267252:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788509473.267255:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcdb7a22300 with x1875387774719232 ext(0->18446744073709551615) 00002000:00010000:1.0:1788509473.267262:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcdb7a22300. 00000100:00100000:1.0:1788509473.340370:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.340543:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774719360 00000100:00100000:3.0:1788509473.340556:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774719360 00000100:00100000:3.0:1788509473.340654:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:3.0:1788509473.340667:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:11329:x1875387774719360:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1788509473.340785:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.340808:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.340854:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.340873:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.340881:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.340887:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341044:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341055:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341063:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788509473.341122:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341136:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341143:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341151:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341168:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4ac00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509473.341174:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341183:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341196:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:3.0:1788509473.341200:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509473.341206:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341222:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ac00/0xe5156b86310ddf7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341241:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341248:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341253:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341259:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509473.341262:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341269:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341287:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcd84f69200) 00010000:00010000:3.0:1788509473.341289:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509473.341293:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341299:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4ae00/0xe5156b86310ddf83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341317:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341323:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341329:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341334:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509473.341338:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341345:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341353:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:3.0:1788509473.341356:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509473.341359:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.341364:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddf8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509473.341476:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:11329:x1875387774719360:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 811us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509473.341486:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:3.0:1788509473.418512:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.418733:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774719616 00000100:00100000:2.0:1788509473.418927:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774719616 00000100:00100000:2.0:1788509473.419189:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:2.0:1788509473.419204:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:11332:x1875387774719616:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509473.419243:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509473.419273:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddf91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755318a expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419368:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419413:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419429:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419448:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419456:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419463:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419661:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310ddfa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419672:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310ddfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419679:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310ddfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509473.419690:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788509473.419813:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419821:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419828:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419842:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509473.419847:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419856:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419870:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509473.419873:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509473.419879:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419886:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddf98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419931:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419938:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419944:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419950:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509473.419953:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419960:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419977:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:2.0:1788509473.419979:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509473.419982:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.419988:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddf9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.420043:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddf91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755318a expref: 33 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.420059:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310ddfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755318a expref: 32 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.420066:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:2.0:1788509473.420068:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788509473.420070:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226c00, rc 0) 00000100:00100000:2.0:1788509473.420162:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:11332:x1875387774719616:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 961us (1663us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788509473.420170:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:1.0:1788509473.431675:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.432034:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774719744 00000100:00100000:3.0:1788509473.432049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774719744 00000100:00100000:3.0:1788509473.432127:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:3.0:1788509473.432139:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:11332:x1875387774719744:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788509473.432243:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.432264:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.432276:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.432322:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.432339:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 32 pid: 6521 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509473.432357:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd84a3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796814720:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509473.440564:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509473.452470:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.454308:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774720000 00000100:00100000:2.0:1788509473.454326:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774720000 00000100:00100000:2.0:1788509473.454412:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788509473.454423:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+33:6178:x1875387774720000:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788509473.455360:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:6178:x1875387774720000:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 929us (2894us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788509473.455372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788509473.458279:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd84a3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796814720:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509473.458341:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509473.459003:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.459253:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774720128 00000100:00100000:2.0:1788509473.459264:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774720128 00010000:00010000:2.0:1788509473.459313:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 34 pid: 6521 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509473.459365:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1788509473.459378:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:2407:x1875387774720128:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509473.459397:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509473.459404:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 34 pid: 6521 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.459420:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 34 pid: 6521 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.459450:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310ddf4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755316e expref: 34 pid: 6521 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.459470:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:2.0:1788509473.459477:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.459487:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.459496:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.459518:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509473.460049:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+33:2407:x1875387774720128:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 670us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509473.460073:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00010000:00010000:0.0:1788509473.460201:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.460218:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.460269:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.460278:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.460285:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.460298:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509473.460303:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.460312:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.460325:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:0.0:1788509473.460329:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509473.460334:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.460341:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310ddfb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509473.460401:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:11332:x1875387774719744:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 28264us (28741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509473.460410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1788509473.473302:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.473470:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774720384 00000100:00100000:2.0:1788509473.473482:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774720384 00000100:00100000:2.0:1788509473.473556:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788509473.473567:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:11332:x1875387774720384:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788509473.473890:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+33:11332:x1875387774720384:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 323us (601us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788509473.473943:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788509473.591485:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.591633:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774720640 00000100:00100000:2.0:1788509473.591653:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774720640 00000100:00100000:2.0:1788509473.591762:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:2.0:1788509473.591775:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+33:11343:x1875387774720640:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788509473.591812:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509473.591845:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddfbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553191 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.591987:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592006:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592030:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592052:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592093:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592101:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592274:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310ddfd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592284:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310ddfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592506:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310ddfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509473.592523:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788509473.592662:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592675:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592683:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592692:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509473.592699:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592711:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592739:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509473.592878:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509473.592885:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.592894:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310ddfc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594514:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594525:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594532:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594537:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509473.594542:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594550:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594567:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:2.0:1788509473.594570:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509473.594575:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594582:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310ddfc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594688:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310ddfbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553191 expref: 36 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594705:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310ddfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553191 expref: 35 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.594712:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:2.0:1788509473.594715:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509473.594718:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc2073600, rc 0) 00000100:00100000:2.0:1788509473.595310:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:11343:x1875387774720640:12345-192.168.203.12@tcp:101:cat.0 Request processed in 3534us (3839us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788509473.595321:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:3.0:1788509473.605989:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.609306:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774720896 00000100:00100000:2.0:1788509473.609328:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774720896 00000100:00100000:2.0:1788509473.609580:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788509473.609722:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:11343:x1875387774720896:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:2.0:1788509473.610141:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:11343:x1875387774720896:12345-192.168.203.12@tcp:35:cat.0 Request processed in 422us (4238us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788509473.611116:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788509473.639432:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.640641:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774721152 00000100:00100000:2.0:1788509473.640653:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774721152 00000100:00100000:2.0:1788509473.640722:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:2.0:1788509473.640732:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:11344:x1875387774721152:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1788509473.640809:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788509473.640835:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4a000/0xe5156b86310ddf6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755317c expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.640866:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310ddfd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553191 expref: 35 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.640880:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310ddfa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755318a expref: 34 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.640892:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4b800/0xe5156b86310ddf60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553175 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.640959:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:2.0:1788509473.640965:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509473.640985:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.640999:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641009:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641022:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641030:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641036:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641119:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641128:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641135:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788509473.641663:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788509473.641674:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370802775081ns, next at 371802772115ns, rc = 0 00010000:00010000:2.0:1788509473.641728:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641739:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641746:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641754:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641760:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641766:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.641971:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788509473.641995:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642023:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642029:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642036:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509473.642041:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642048:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642058:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:2.0:1788509473.642061:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788509473.642065:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642071:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310ddfec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642088:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642094:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642100:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642105:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509473.642114:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642122:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642130:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509473.642133:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509473.642135:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642141:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310ddfde lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788509473.642152:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe44256a reply state 0000000018bd2199 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642162:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.642168:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:2.0:1788509473.642170:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788509473.642173:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788509473.642529:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:11344:x1875387774721152:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1795us (3102us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788509473.642539:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00010000:00010000:3.0:1788509473.643804:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509473.643815:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.643824:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073e00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509473.643829:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.643838:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.643854:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:3.0:1788509473.643857:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788509473.643861:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.643867:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310ddff3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.643881:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509473.643883:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509473.643884:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509473.687851:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509473.700228:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509473.700333:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774721408 00000100:00100000:0.0:1788509473.700344:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774721408 00000100:00100000:0.0:1788509473.700425:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:0.0:1788509473.700436:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:11350:x1875387774721408:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509473.700459:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509473.700480:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddffa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553198 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.700615:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.700629:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.700640:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.700650:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.700657:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.700663:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788509473.701005:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788509473.701139:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701148:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701156:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701188:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701207:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701214:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701220:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509473.701225:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701232:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701243:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509473.701246:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509473.701250:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701256:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de001 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509473.701270:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054eecd7c reply state 00000000c24d83cf transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701281:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701287:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:0.0:1788509473.701289:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509473.701292:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788509473.701318:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310ddffa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701340:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.701348:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc865bbf00) 00010000:00010000:0.0:1788509473.701351:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509473.701353:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a400, rc 0) 00000100:00100000:0.0:1788509473.701426:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:11350:x1875387774721408:12345-192.168.203.12@tcp:101:bash.0 Request processed in 991us (1207us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788509473.701433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:3.0:1788509473.707148:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.707270:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774721536 00000100:00100000:2.0:1788509473.707280:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774721536 00000100:00100000:2.0:1788509473.707341:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788509473.707360:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774721536:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509473.707394:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509473.707415:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755319f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509473.707440:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509473.707458:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1788509473.707463:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509473.707472:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.707492:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.707504:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc2073200, rc 0) 00000100:00100000:2.0:1788509473.707566:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774721536:12345-192.168.203.12@tcp:101:bash.0 Request processed in 216us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509473.707573:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1788509473.710260:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509473.710341:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774721664 00000100:00100000:0.0:1788509473.710361:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774721664 00000100:00100000:0.0:1788509473.710429:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788509473.710439:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:11350:x1875387774721664:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509473.710455:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509473.710473:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531a6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.710505:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.710515:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509473.710520:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509473.710525:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.710606:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.710623:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 9 pid: 8436 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509473.710637:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875387796814848:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509473.710734:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82eda000 going to sleep for 11 seconds 00000100:00100000:0.0:1788509473.719879:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.720015:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875387796814848:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509473.720049:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.720094:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b000, rc 0) 00000100:00100000:3.0:1788509473.720159:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:11350:x1875387774721664:12345-192.168.203.12@tcp:101:bash.0 Request processed in 9721us (9908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509473.720168:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1788509473.722662:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774721792 00000100:00100000:1.0:1788509473.722674:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774721792 00010000:00010000:1.0:1788509473.722731:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 9 pid: 8436 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509473.722775:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1788509473.722783:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774721792:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509473.722797:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509473.722830:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 9 pid: 8436 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.722843:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 9 pid: 8436 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.722864:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c9b02fe/0xe5156b86310de01d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755319f expref: 9 pid: 8436 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.722880:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509473.722884:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509473.722891:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.722926:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.723192:0:7472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509473.723208:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ec7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7472:1875387796814976:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788509473.723297:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788509473.725512:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ec7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7472:1875387796814976:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788509473.725536:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509473.725586:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774721792:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 2803us (5717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509473.725620:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1788509473.726318:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509473.726390:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774722048 00000100:00100000:1.0:1788509473.726397:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774722048 00000100:00100000:1.0:1788509473.726439:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788509473.726447:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:11350:x1875387774722048:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1788509473.726694:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:11350:x1875387774722048:12345-192.168.203.12@tcp:35:bash.0 Request processed in 247us (377us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788509473.726712:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788509473.972057:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509473.972156:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774722176 00000100:00100000:0.0:1788509473.972166:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774722176 00000100:00100000:0.0:1788509473.972226:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:0.0:1788509473.972236:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:11366:x1875387774722176:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509473.972259:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509473.972281:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.972347:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de032 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.972362:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.972375:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509473.972440:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788509473.972444:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509473.972463:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.972488:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ad expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.972507:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de032 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ad expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509473.972516:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:0.0:1788509473.972518:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509473.972522:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590ae00, rc 0) 00000100:00100000:0.0:1788509473.972585:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:11366:x1875387774722176:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 350us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509473.972592:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:0.0:1788509473.979348:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509473.979634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774722432 00000100:00100000:3.0:1788509473.979645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774722432 00000100:00100000:3.0:1788509473.979716:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1788509473.979727:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:11366:x1875387774722432:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509473.979744:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509473.979762:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de039 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531b4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.979864:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de040 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.979878:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.979891:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509473.979944:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788509473.980043:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de039 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531b4 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.980063:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de040 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531b4 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509473.980086:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc865bbf00) 00010000:00010000:3.0:1788509473.980089:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788509473.980093:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030800, rc 0) 00000100:00100000:3.0:1788509473.980158:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+41:11366:x1875387774722432:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 433us (818us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788509473.980166:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1788509473.991077:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509473.991381:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509473.991662:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774722816 00000100:00100000:2.0:1788509473.991673:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774722816 00000100:00100000:2.0:1788509473.991742:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:2.0:1788509473.991752:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+41:11366:x1875387774722816:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509473.991774:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509473.991794:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de04e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531bb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.991942:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de055 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.991957:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.991969:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de055 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509473.991980:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788509473.992081:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de04e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531bb expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.992102:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de055 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531bb expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509473.992110:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc865bbf00) 00010000:00010000:2.0:1788509473.992113:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788509473.992116:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc2072400, rc 0) 00000100:00100000:2.0:1788509473.992180:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:11366:x1875387774722816:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 429us (803us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788509473.992188:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:1.0:1788509473.994220:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774722560 00000100:00100000:1.0:1788509473.994232:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774722560 00000100:00100000:1.0:1788509473.994339:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788509473.994349:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:2407:x1875387774722560:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509473.994370:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509473.994392:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de040 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531b4 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509473.994410:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc865bbf00) 00010000:00010000:1.0:1788509473.994414:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509473.994458:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+42:2407:x1875387774722560:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 111us (3391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509473.994464:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788509474.000454:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.000718:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774722944 00000100:00100000:2.0:1788509474.000732:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774722944 00000100:00100000:2.0:1788509474.000938:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788509474.000951:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774722944:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:2.0:1788509474.001011:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.001069:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.001079:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788509474.001084:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788509474.001090:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.001137:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.001154:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 8 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.001172:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875387796815104:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509474.001297:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767480 going to sleep for 11 seconds 00000100:00100000:0.0:1788509474.013039:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.013225:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774723072 00000100:00100000:3.0:1788509474.013239:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774723072 00002000:00100000:3.0:1788509474.013308:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8bcc874d9f80 x1875387774723072/t0(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:555/0 lens 504/0 e 0 to 0 dl 1788509485 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788509474.013320:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc874d9f80 with x1875387774723072 ext(0->8) 00010000:00010000:3.0:1788509474.013331:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 9 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.013351:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 9 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509474.013359:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bcc874d9f80 00000100:00100000:3.0:1788509474.013400:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788509474.013411:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774723072:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:2.0:1788509474.017726:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875387796815104:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509474.017770:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.019646:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:2408:x1875387774723072:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 6226us (6622us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788509474.020995:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00100000:0.0:1788509474.021013:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8bcc874d9f80 x1875387774723072/t4294967303(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:555/0 lens 504/448 e 0 to 0 dl 1788509485 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788509474.021024:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc874d9f80 with x1875387774723072 ext(0->8) 00010000:00010000:0.0:1788509474.021117:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 11 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.021137:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 11 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788509474.021146:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bcc874d9f80 00000100:00100000:0.0:1788509474.024135:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.024275:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774723200 00000100:00100000:2.0:1788509474.024293:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774723200 00010000:00010000:2.0:1788509474.024372:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 11 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.024523:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1788509474.024536:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:2407:x1875387774723200:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509474.024556:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788509474.024602:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788509474.024605:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788509473 00002000:00010000:2.0:1788509474.024608:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788509473 00002000:00010000:2.0:1788509474.024611:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788509473 00002000:00010000:2.0:1788509474.024613:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788509474.024620:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 11 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.024637:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 11 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.024678:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b93a862/0xe5156b86310de024 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531a6 expref: 11 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.024701:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788509474.024705:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788509474.024712:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.024722:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.024784:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509474.024838:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.024863:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2407:x1875387774723200:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 327us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.024874:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00010000:00010000:3.0:1788509474.024891:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.024981:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.024990:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.024998:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.025004:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509474.025008:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.025017:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.025202:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.025213:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000623b06ef/0xe5156b86310de063 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.025344:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774722944:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 24392us (24899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509474.025354:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788509474.028689:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.028835:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774723456 00000100:00100000:3.0:1788509474.028845:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774723456 00000100:00100000:3.0:1788509474.028930:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00080000:0.0:1788509474.029389:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509474.029432:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+42:11366:x1875387774723456:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:3.0:1788509474.029494:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de055 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531bb expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788509474.030759:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788509474.030803:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788509474.032130:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1788509474.032220:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.032246:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.032269:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.032331:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.032352:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 46 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.032373:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ec7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875387796815232:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509474.032492:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509474.037290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.038169:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ec7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875387796815232:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509474.038208:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.040206:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774723584 00000100:00100000:2.0:1788509474.040225:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774723584 00010000:00010000:2.0:1788509474.040294:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 47 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.040550:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788509474.040563:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+47:2408:x1875387774723584:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509474.040605:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509474.040614:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 47 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.040630:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 47 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.040659:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de00f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553198 expref: 47 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.040683:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc865bbf00) 00010000:00010000:2.0:1788509474.040689:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.040700:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.040728:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.040771:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509474.040852:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+46:2408:x1875387774723584:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 291us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.040860:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00010000:00010000:3.0:1788509474.040980:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.040997:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788509474.041114:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788509474.041255:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788509474.047210:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a25c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875387796815360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788509474.047306:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509474.047341:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509474.047702:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796815360 00000100:00100000:1.0:1788509474.047719:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796815360 00000100:00100000:1.0:1788509474.047835:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788509474.047853:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1875387796815360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788509474.048036:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1875387796815360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 189us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.048047:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788509474.048083:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a25c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875387796815360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788509474.048252:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788509474.048323:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a25c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875387796815488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788509474.048373:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509474.048400:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509474.048657:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796815488 00000100:00100000:1.0:1788509474.048666:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796815488 00000100:00100000:1.0:1788509474.048717:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788509474.048726:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1875387796815488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788509474.048953:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6524:x1875387796815488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 229us (579us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788509474.048961:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788509474.049015:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a25c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875387796815488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788509474.049078:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788509474.049121:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.049131:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.049138:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.049144:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509474.049148:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.049156:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.049171:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc865bbf00) 00010000:00010000:0.0:1788509474.049182:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788509474.049188:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.049195:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de06a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788509474.049404:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788509474.049479:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788509474.049541:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788509474.049553:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371210654467ns, next at 372210652351ns, rc = 0 00000001:00080000:0.0:1788509474.049560:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788509474.049584:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc865bbf00) 00010000:00010000:0.0:1788509474.049587:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788509474.049604:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de055 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531bb expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.049934:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+49:11366:x1875387774723456:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 20506us (21251us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788509474.049943:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000020:00080000:0.0:1788509474.049949:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788509474.052498:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.052643:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774723712 00000100:00100000:1.0:1788509474.053203:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774723712 00000100:00100000:1.0:1788509474.053452:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:1.0:1788509474.053463:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+49:11366:x1875387774723712:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509474.053486:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509474.053507:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de071 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531c2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.053562:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de071 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c2 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.053577:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de071 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c2 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.053606:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:1.0:1788509474.053609:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788509474.053613:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8e00, rc 0) 00000100:00100000:1.0:1788509474.053692:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+50:11366:x1875387774723712:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 230us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.053699:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:3.0:1788509474.061085:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.061264:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774723968 00000100:00100000:2.0:1788509474.061273:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774723968 00000100:00100000:2.0:1788509474.061372:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788509474.061382:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+50:11366:x1875387774723968:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788509474.061619:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+51:11366:x1875387774723968:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 237us (541us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788509474.061627:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788509474.157758:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.157867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774724096 00000100:00100000:2.0:1788509474.157881:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774724096 00000100:00100000:2.0:1788509474.157989:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:2.0:1788509474.157999:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+51:11376:x1875387774724096:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788509474.158074:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158093:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158104:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158135:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158142:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158149:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158218:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158227:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158234:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788509474.158279:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158292:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158299:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158306:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158313:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.158317:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158330:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158342:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509474.158345:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.158350:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158357:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de078 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158371:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158378:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158384:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158389:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.158392:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158398:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158405:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:2.0:1788509474.158407:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.158410:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158424:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de07f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158435:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158440:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158446:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158450:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.158453:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158458:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158465:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.158467:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.158471:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.158476:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de086 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.158562:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+51:11376:x1875387774724096:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 563us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.158571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:3.0:1788509474.201009:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.201145:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774724352 00000100:00100000:2.0:1788509474.201155:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774724352 00000100:00100000:2.0:1788509474.201223:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:2.0:1788509474.201234:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+51:11379:x1875387774724352:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509474.201253:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.201274:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de08d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531c9 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201342:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201357:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201369:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201380:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201388:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201395:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201504:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201513:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201537:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509474.201547:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788509474.201627:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201635:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201641:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.201647:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.201650:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202071:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202084:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509474.202087:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.202092:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202098:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de094 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202112:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202119:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202131:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202136:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.202139:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202145:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202152:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:2.0:1788509474.202155:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.202158:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202164:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de09b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202202:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de08d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 54 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202215:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 53 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.202221:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.202223:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509474.202226:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc2072200, rc 0) 00000100:00100000:2.0:1788509474.202288:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+53:11379:x1875387774724352:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1055us (1287us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788509474.202305:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:3.0:1788509474.205382:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.205459:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774724480 00000100:00100000:2.0:1788509474.205469:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774724480 00000100:00100000:2.0:1788509474.205525:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788509474.205535:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+53:11379:x1875387774724480:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788509474.205628:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205646:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205668:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205711:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205719:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205726:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205732:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073e00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.205736:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205744:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205755:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.205771:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788509474.205776:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.205783:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.205857:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+53:11379:x1875387774724480:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 322us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.205865:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1788509474.207838:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.207944:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774724736 00000100:00100000:1.0:1788509474.207956:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774724736 00000100:00100000:1.0:1788509474.208009:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788509474.208018:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+53:11379:x1875387774724736:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509474.208232:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:11379:x1875387774724736:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 214us (406us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788509474.208240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1788509474.288008:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.288291:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774724992 00000100:00100000:1.0:1788509474.288305:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774724992 00000100:00100000:1.0:1788509474.288400:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:1.0:1788509474.288413:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:11389:x1875387774724992:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788509474.288447:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509474.288452:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788509474.288490:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de032 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ad expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.288523:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:1.0:1788509474.288529:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509474.288546:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de0b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531d0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.288701:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.288717:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 54 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.288728:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.288766:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 54 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.288805:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 54 pid: 9006 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.288821:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ec7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796815616:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509474.289373:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509474.293517:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ec7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796815616:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509474.293560:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.295887:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.296329:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774725120 00000100:00100000:1.0:1788509474.296341:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774725120 00010000:00010000:1.0:1788509474.296399:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 55 pid: 9006 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.296451:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1788509474.296462:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+55:2408:x1875387774725120:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509474.296481:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509474.296489:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 55 pid: 9006 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.296514:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 55 pid: 9006 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.296553:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c9 expref: 55 pid: 9006 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.296615:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:1.0:1788509474.296621:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.296632:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.296641:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.296676:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509474.297215:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:2408:x1875387774725120:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 749us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.297225:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00010000:00010000:3.0:1788509474.297436:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.297447:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509474.297471:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788509474.297668:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de0b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.297690:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.297698:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:3.0:1788509474.297701:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788509474.297704:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8400, rc 0) 00000100:00100000:3.0:1788509474.297752:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:11389:x1875387774724992:12345-192.168.203.12@tcp:101:bash.0 Request processed in 9343us (9761us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788509474.297760:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1788509474.302057:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.302171:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774725248 00000100:00100000:2.0:1788509474.302184:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774725248 00000100:00100000:2.0:1788509474.302290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:2.0:1788509474.302303:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:11389:x1875387774725248:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509474.302334:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.302360:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531d7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.302404:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.302423:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.302437:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.302620:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de0cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.302653:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.302662:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.302666:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788509474.302670:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc2073200, rc 0) 00000100:00100000:2.0:1788509474.302747:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+55:11389:x1875387774725248:12345-192.168.203.12@tcp:101:bash.0 Request processed in 448us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.302754:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1788509474.305752:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509474.307183:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774725504 00000100:00100000:0.0:1788509474.307202:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774725504 00000100:00100000:2.0:1788509474.307309:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1788509474.307326:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+55:11389:x1875387774725504:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788509474.307855:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.307879:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.307893:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788509474.308127:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788509474.308156:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068e7b582 reply state 0000000088772e5e transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.308170:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.308179:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.308199:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788509474.308204:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788509474.308329:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+58:11389:x1875387774725504:12345-192.168.203.12@tcp:36:bash.0 Request processed in 1006us (2587us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788509474.308337:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000020:00080000:2.0:1788509474.308342:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788509474.311150:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.311280:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774725632 00000100:00100000:2.0:1788509474.311293:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774725632 00000100:00100000:2.0:1788509474.311361:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1788509474.311372:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+58:11389:x1875387774725632:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509474.311402:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.311427:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de0e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531de expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.311551:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.311570:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.311580:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.311634:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.311649:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 59 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.311665:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796815744:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509474.311766:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509474.316142:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796815744:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509474.316205:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.317358:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509474.317462:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774725760 00000100:00100000:0.0:1788509474.317472:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774725760 00010000:00010000:0.0:1788509474.317539:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 60 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.317616:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:0.0:1788509474.317627:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:2407:x1875387774725760:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509474.317645:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509474.317653:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 60 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.317667:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 60 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.317694:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de0be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d0 expref: 60 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.317716:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509474.317722:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.317734:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.317742:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.317774:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509474.318358:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+59:2407:x1875387774725760:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 221us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509474.318371:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00010000:00010000:3.0:1788509474.318665:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.318676:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509474.318749:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788509474.318755:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788509474.318781:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.318822:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de0e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.318841:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.318850:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:3.0:1788509474.318853:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788509474.318856:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc2072200, rc 0) 00000100:00100000:3.0:1788509474.319136:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+58:11389:x1875387774725632:12345-192.168.203.12@tcp:101:bash.0 Request processed in 7764us (7997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509474.319143:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1788509474.323855:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.324220:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774726016 00000100:00100000:1.0:1788509474.324234:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774726016 00000100:00100000:1.0:1788509474.324343:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1788509474.324356:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+58:11389:x1875387774726016:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1788509474.324782:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+59:11389:x1875387774726016:12345-192.168.203.12@tcp:35:bash.0 Request processed in 427us (940us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788509474.324791:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1788509474.379822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.380328:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774726144 00000100:00100000:2.0:1788509474.380341:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774726144 00000100:00100000:2.0:1788509474.380420:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:2.0:1788509474.380433:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+59:11395:x1875387774726144:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509474.380466:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.380495:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de0ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531e5 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.380578:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310de0f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.380605:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310de0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.380619:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310de0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509474.380679:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788509474.380684:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509474.380707:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310de0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.380737:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de0ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531e5 expref: 61 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.380758:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310de0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531e5 expref: 60 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.380793:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509474.380797:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788509474.380801:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227800, rc 0) 00000100:00100000:2.0:1788509474.381220:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:11395:x1875387774726144:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 787us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.381228:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:1.0:1788509474.386367:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.386472:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774726272 00000100:00100000:2.0:1788509474.386485:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774726272 00000100:00100000:2.0:1788509474.386674:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1788509474.386687:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:11395:x1875387774726272:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509474.386715:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.386742:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de0fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531ec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.386820:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.386839:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.386867:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.386883:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.386892:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387147:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387241:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387251:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387259:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509474.387310:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788509474.387316:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509474.387340:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387354:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387362:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387368:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387374:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387380:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.387385:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387400:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387414:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509474.387417:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.387423:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387430:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de104 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387444:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387450:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387455:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387460:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.387463:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387469:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387476:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:2.0:1788509474.387479:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.387482:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387512:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de10b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387548:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de0fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387564:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.387571:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.387574:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509474.387576:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc2073e00, rc 0) 00000100:00100000:2.0:1788509474.387729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11395:x1875387774726272:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1044us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.387737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1788509474.392713:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.392838:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509474.393127:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774726528 00000100:00100000:0.0:1788509474.393148:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774726528 00000100:00100000:0.0:1788509474.393217:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1788509474.393229:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11395:x1875387774726528:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509474.393253:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509474.393279:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de119 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531f3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.393425:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.393443:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.393451:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.393461:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.393585:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.393611:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 62 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.393627:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796815872:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509474.393794:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.393816:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 62 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.393826:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796816000:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509474.393862:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82eda000 going to sleep for 11 seconds 00000100:00100000:3.0:1788509474.394108:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774726656 00000100:00100000:3.0:1788509474.394115:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774726656 00010000:00010000:3.0:1788509474.394148:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 63 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.394188:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788509474.394195:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:2409:x1875387774726656:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509474.394207:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509474.394214:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 63 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.394227:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 63 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.394248:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:3.0:1788509474.394254:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.394262:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.394270:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509474.394299:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:2409:x1875387774726656:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 104us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509474.394307:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1788509474.398672:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1788509474.398826:0:6521:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.12@tcp) returned -22 from blocking AST (req@000000001b7c48f6 x1875387796815872) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 62 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.398869:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de112 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531ec expref: 62 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.398893:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796815872:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509474.398949:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796816000:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509474.399000:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.399007:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.399017:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.399027:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.399435:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774726784 00000100:00100000:3.0:1788509474.399445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774726784 00010000:00010000:1.0:1788509474.399690:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 62 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.399781:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1788509474.399792:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+62:2408:x1875387774726784:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509474.399811:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509474.399818:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 62 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.399831:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 62 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.400123:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de0e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531de expref: 62 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.400140:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:1.0:1788509474.400145:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.400155:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.400163:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.400199:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509474.400276:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:2408:x1875387774726784:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 485us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.400284:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00010000:00010000:0.0:1788509474.400372:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.400381:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509474.400404:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788509474.400586:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de119 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.400616:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.400624:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509474.400626:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788509474.400629:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a000, rc 0) 00000100:00100000:0.0:1788509474.400658:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11395:x1875387774726528:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 7432us (7960us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788509474.400665:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1788509474.403148:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.403674:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774727040 00000100:00100000:2.0:1788509474.403689:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774727040 00000100:00100000:2.0:1788509474.403774:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788509474.403786:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11395:x1875387774727040:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:2.0:1788509474.403806:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509474.403835:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de071 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531c2 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.403870:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.403877:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509474.404156:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:11395:x1875387774727040:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 371us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.404165:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788509474.406105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.406290:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774727168 00000100:00100000:2.0:1788509474.406301:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774727168 00000100:00100000:2.0:1788509474.406369:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1788509474.406381:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:11395:x1875387774727168:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:2.0:1788509474.406536:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.406575:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.406589:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788509474.406724:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788509474.406832:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:11395:x1875387774727168:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 452us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.406841:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1788509474.409379:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.409470:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774727296 00000100:00100000:2.0:1788509474.409482:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774727296 00000100:00100000:2.0:1788509474.409568:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:2.0:1788509474.409580:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:11395:x1875387774727296:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509474.409621:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.409650:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475531fa expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.409719:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.409732:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 61 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.409753:0:9006:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.409766:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 61 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.409792:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.409795:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509474.409800:0:9006:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 61 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.409808:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226000, rc 0) 00000100:00100000:2.0:1788509474.409879:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11395:x1875387774727296:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 301us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.409886:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000040:00080000:0.0:1788509474.520013:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509474.520025:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509474.520098:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788509474.520113:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788509474.521199:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796816128:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788509474.521356:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509474.529521:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796816128:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788509474.536759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.538083:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774727424 00000100:00100000:2.0:1788509474.538102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774727424 00000100:00100000:2.0:1788509474.538192:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:2.0:1788509474.538205:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11396:x1875387774727424:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788509474.538261:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788509474.538457:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11396:x1875387774727424:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 253us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.538465:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1788509474.544790:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.545354:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774727552 00000100:00100000:2.0:1788509474.545443:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774727552 00000100:00100000:2.0:1788509474.545588:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:2.0:1788509474.557060:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11396:x1875387774727552:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788509474.558716:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.558745:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.558782:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.558806:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.558813:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.558820:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.558875:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.558886:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.558894:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509474.560914:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788509474.560996:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509474.561072:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.561095:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.561103:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.561893:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.561998:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.562004:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562015:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562101:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:2.0:1788509474.562105:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.562187:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562196:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310de13c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562224:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562348:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562355:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562360:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.562363:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562384:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562394:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.562396:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.562400:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562406:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310de143 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562432:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562439:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562444:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562449:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.562452:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562458:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562466:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.562468:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.562471:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.562488:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de14a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.562893:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11396:x1875387774727552:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 5865us (18109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.562998:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:1.0:1788509474.570880:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.571356:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774727808 00000100:00100000:3.0:1788509474.571396:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774727808 00000100:00100000:3.0:1788509474.571472:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:3.0:1788509474.571484:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+61:11396:x1875387774727808:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509474.571512:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509474.571540:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310de151 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553201 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572101:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572255:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572270:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509474.572285:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788509474.572393:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572402:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572409:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572415:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509474.572420:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572428:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:3.0:1788509474.572457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788509474.572463:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572471:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de158 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572714:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310de151 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553201 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572729:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:3.0:1788509474.572731:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788509474.572736:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310de151 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553201 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.572747:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030600, rc 0) 00000100:00100000:3.0:1788509474.572895:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+62:11396:x1875387774727808:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1412us (2030us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1788509474.572961:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:3.0:1788509474.578366:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.578549:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774727936 00000100:00100000:1.0:1788509474.578563:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774727936 00000100:00100000:1.0:1788509474.578659:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1788509474.578671:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+62:11396:x1875387774727936:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788509474.578718:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788509474.578872:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+62:11396:x1875387774727936:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 204us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.578881:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1788509474.587087:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.590380:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774728192 00000100:00100000:2.0:1788509474.590403:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774728192 00000100:00100000:3.0:1788509474.591464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:3.0:1788509474.591478:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+62:11396:x1875387774728192:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509474.591514:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509474.591517:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788509474.591552:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310de0f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531e5 expref: 62 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.591613:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:3.0:1788509474.591619:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509474.591646:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310de166 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553208 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788509474.592618:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788509474.594765:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de16d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.594798:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de16d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.594815:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de16d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.595419:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030600/0xe5156b86310de166 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553208 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.595448:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de16d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553208 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.595459:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcd8a893700) 00010000:00010000:3.0:1788509474.595462:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788509474.595468:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030a00, rc 0) 00000100:00100000:3.0:1788509474.596241:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:11396:x1875387774728192:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4758us (9160us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788509474.596264:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:3.0:1788509474.604348:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.604549:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774728448 00000100:00100000:1.0:1788509474.604565:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774728448 00000100:00100000:1.0:1788509474.604660:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:1.0:1788509474.604673:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:11396:x1875387774728448:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788509474.605152:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509474.605199:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de16d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553208 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605225:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcd8a893700) 00010000:00010000:1.0:1788509474.605248:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509474.605277:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605294:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605306:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605345:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605354:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605362:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605419:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605427:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605434:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605440:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509474.605445:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605453:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605462:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:1.0:1788509474.605465:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509474.605469:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605477:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de17b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605496:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605501:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605507:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605513:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073e00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509474.605516:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605522:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605530:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x364168e1 (ffff8bcc8761ee00) 00010000:00010000:1.0:1788509474.605533:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509474.605536:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.605542:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de182 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x364168e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.605668:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+62:11396:x1875387774728448:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 995us (1335us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788509474.605686:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1788509474.612151:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.612514:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774728576 00000100:00100000:2.0:1788509474.612528:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774728576 00000100:00100000:2.0:1788509474.612618:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1788509474.612643:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+62:11396:x1875387774728576:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509474.612673:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.612707:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de189 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755320f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.612752:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.612768:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.612781:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.612973:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de189 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.612996:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.613015:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.613018:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788509474.613023:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3200, rc 0) 00000100:00100000:2.0:1788509474.613119:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:11396:x1875387774728576:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 472us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.613127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1788509474.622183:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.623253:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774728832 00000100:00100000:1.0:1788509474.623269:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774728832 00000100:00100000:1.0:1788509474.623415:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:1.0:1788509474.623447:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:11396:x1875387774728832:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788509474.623606:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.623805:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.623821:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788509474.624064:0:9006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1788509474.624143:0:9006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000499155fa reply state 0000000003ed9f41 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.624159:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.624169:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:1.0:1788509474.624172:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788509474.624177:0:9006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788509474.624385:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:11396:x1875387774728832:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 939us (2215us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788509474.624394:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:1.0:1788509474.628051:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.628382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774728960 00000100:00100000:2.0:1788509474.628396:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774728960 00000100:00100000:2.0:1788509474.628476:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1788509474.628488:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:11396:x1875387774728960:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509474.628521:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.628563:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553216 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.628659:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.628676:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.628698:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.628701:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509474.628706:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2400, rc 0) 00000100:00100000:2.0:1788509474.628788:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:11396:x1875387774728960:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 302us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.628816:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:3.0:1788509474.633030:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.633804:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774729088 00000100:00100000:2.0:1788509474.633820:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774729088 00000100:00100000:2.0:1788509474.633980:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788509474.633997:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774729088:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788509474.634305:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509474.634635:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2407:x1875387774729088:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 633us (1610us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788509474.634646:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788509474.639420:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.639749:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774729344 00000100:00100000:2.0:1788509474.639763:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774729344 00000100:00100000:2.0:1788509474.639844:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1788509474.639856:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:11396:x1875387774729344:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788509474.640422:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:11396:x1875387774729344:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 565us (1015us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788509474.640431:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1788509474.643572:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509474.643669:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774729600 00000100:00100000:0.0:1788509474.643683:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774729600 00000100:00100000:0.0:1788509474.643767:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1788509474.643781:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:11396:x1875387774729600:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788509474.645008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:11396:x1875387774729600:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 1220us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509474.645021:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:3.0:1788509474.648362:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.648775:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774729728 00000100:00100000:2.0:1788509474.648788:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774729728 00000100:00100000:2.0:1788509474.648978:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:2.0:1788509474.648992:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:11396:x1875387774729728:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509474.649020:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.649048:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3800/0xe5156b86310de1a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755321d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.649294:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.649327:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.649485:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509474.649706:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509474.649736:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.649774:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3800/0xe5156b86310de1a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755321d expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.649796:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755321d expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.649806:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.649809:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788509474.649813:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2e00, rc 0) 00000100:00100000:2.0:1788509474.650252:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+68:11396:x1875387774729728:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1120us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.650263:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:0.0:1788509474.653465:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.653702:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774729856 00000100:00100000:3.0:1788509474.653716:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774729856 00000100:00100000:3.0:1788509474.653793:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788509474.653806:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774729856:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509474.653831:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509474.653855:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553224 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509474.653888:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a7d22, blocks: 0x0 00010000:00010000:3.0:1788509474.653996:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1788509474.654001:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509474.654012:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.654036:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.654051:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030600, rc 0) 00000100:00100000:3.0:1788509474.654259:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2408:x1875387774729856:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 455us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509474.654267:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788509474.657474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.657572:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774730112 00000100:00100000:2.0:1788509474.657586:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774730112 00000100:00100000:2.0:1788509474.657695:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:2.0:1788509474.657707:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+68:11396:x1875387774730112:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788509474.657849:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+68:11396:x1875387774730112:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 143us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.657876:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:1.0:1788509474.663603:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.663849:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774730240 00000100:00100000:3.0:1788509474.664233:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774730240 00000100:00100000:3.0:1788509474.664351:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788509474.664365:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:11396:x1875387774730240:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509474.664390:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509474.664416:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755322b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.664457:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.664468:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509474.664473:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509474.664479:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.664538:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.664553:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 11 pid: 8438 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.664568:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796816256:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509474.664887:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509474.671041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509474.671310:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796816256:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509474.671358:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.671385:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030a00, rc 0) 00000100:00100000:0.0:1788509474.671466:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:11396:x1875387774730240:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 7104us (7888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509474.671476:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1788509474.672423:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774730368 00000100:00100000:1.0:1788509474.672435:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774730368 00010000:00010000:1.0:1788509474.672486:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 11 pid: 8438 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.672568:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1788509474.672580:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:2407:x1875387774730368:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509474.672610:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509474.672640:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 11 pid: 8438 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.672657:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 11 pid: 8438 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.672683:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de1b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553224 expref: 11 pid: 8438 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.672702:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509474.672707:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509474.672717:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.672729:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.672774:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.672790:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ec6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1875387796816384:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788509474.672966:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788509474.679319:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ec6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1875387796816384:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788509474.679365:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509474.679493:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2407:x1875387774730368:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 6913us (8464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.679516:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1788509474.680151:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.680271:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774730496 00000100:00100000:1.0:1788509474.680280:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774730496 00002000:00100000:1.0:1788509474.680340:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8bcc87ea4380 x1875387774730496/t0(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:555/0 lens 504/0 e 0 to 0 dl 1788509485 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509474.680353:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc87ea4380 with x1875387774730496 ext(0->12) 00002000:00010000:1.0:1788509474.680360:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcc87ea4380 00000100:00100000:1.0:1788509474.680402:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1788509474.680414:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2408:x1875387774730496:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788509474.683770:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:2408:x1875387774730496:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 3343us (3606us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788509474.683789:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:1.0:1788509474.683805:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8bcc87ea4380 x1875387774730496/t4294967309(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:555/0 lens 504/448 e 0 to 0 dl 1788509485 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509474.683815:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc87ea4380 with x1875387774730496 ext(0->12) 00002000:00010000:1.0:1788509474.683824:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcc87ea4380 00000100:00100000:2.0:1788509474.687355:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.687459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774730624 00000100:00100000:3.0:1788509474.687471:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774730624 00000100:00100000:3.0:1788509474.687609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:3.0:1788509474.687622:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+68:11396:x1875387774730624:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788509474.694313:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788509474.694373:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:2.0:1788509474.694506:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694522:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694531:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694539:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.694544:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694554:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694576:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8bcc8761e900) 00010000:00010000:2.0:1788509474.694580:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.694587:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694603:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310ddebf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694646:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694653:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694667:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694672:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.694675:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694681:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694689:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8bcc8761e200) 00010000:00010000:2.0:1788509474.694692:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.694695:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694700:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310ddf67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694716:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694722:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694727:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694732:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.694735:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694750:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694759:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:2.0:1788509474.694761:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.694765:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694770:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310ddfe5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694782:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694789:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694795:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694800:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.694803:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694809:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694816:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047200) 00010000:00010000:2.0:1788509474.694818:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.694821:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694833:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de008 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694852:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694858:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694863:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694947:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.694950:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694957:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694966:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.694968:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.694971:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694977:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de0da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694988:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.694994:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.695006:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.695012:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.695015:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.695021:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.695029:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.695032:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788509474.695046:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.695054:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de197 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.696482:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796816512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788509474.696579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509474.696826:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796816512 00000100:00100000:1.0:1788509474.696837:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796816512 00000100:00100000:3.0:1788509474.697015:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788509474.697029:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1875387796816512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788509474.697088:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1788509474.697141:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9a7d21, atime: 0x6a9a7d21, ctime: 0x6a9a7d21, blocks: 0x8 00010000:00010000:3.0:1788509474.697151:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697170:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1788509474.697176:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509474.697184:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697201:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697213:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697221:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697244:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788509474.697468:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3644:x1875387796816512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 443us (889us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788509474.697476:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1788509474.697526:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509474.697533:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697542:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509474.697547:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697557:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697576:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697584:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de1c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.697616:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509474.697618:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509474.697620:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788509474.699457:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcc87ec5880/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788509474.699473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796816512:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788509474.699850:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bcc876dc3c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788509474.699861:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcdb5993000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bcc876dc300 00000020:00080000:0.0:1788509474.699864:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcdb5993d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bcc87cbd000 00000004:00080000:0.0:1788509474.699936:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788509474.699982:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bcdb5a4aa80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788509474.699986:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcc8779c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bcdb5a4a600 00000020:00080000:0.0:1788509474.699989:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcc8779cf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bcd92006200 00000020:00080000:2.0:1788509474.700272:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788509474.700381:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788509474.700539:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509474.700558:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796816640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788509474.700649:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11396:x1875387774730624:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 13024us (13304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509474.700664:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509474.700675:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:3.0:1788509474.700742:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796816640 00000100:00100000:3.0:1788509474.700750:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796816640 00000100:00100000:3.0:1788509474.700804:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788509474.700813:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796816640:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788509474.703028:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788509474.704427:0:8756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1788509474.704588:0:8756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.704626:0:8756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 11 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.704635:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788509474.704640:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509474.704645:0:8756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.704682:0:8756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 11 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.704695:0:8756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 11 pid: 8756 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.704879:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.706004:0:8756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8756:1875387796816768:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509474.706105:0:8756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8bf00 going to sleep for 11 seconds 00000001:00080000:2.0:1788509474.706525:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788509474.706544:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788509474.706723:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774730752 00000100:00100000:1.0:1788509474.706735:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774730752 00000100:00100000:1.0:1788509474.708293:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:1.0:1788509474.708323:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:2407:x1875387774730752:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788509474.710627:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.710938:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774730880 00000100:00100000:1.0:1788509474.710954:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774730880 00010000:00010000:1.0:1788509474.711011:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 13 pid: 8756 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.711060:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788509474.711084:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:2407:x1875387774730880:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509474.711100:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509474.711106:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 13 pid: 8756 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.711270:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509474.711277:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 13 pid: 8756 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.711309:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509474.711314:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509474.711321:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.711333:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.711371:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509474.711516:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:2407:x1875387774730880:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 445us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.711538:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00010000:00010000:3.0:1788509474.712656:0:8756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310ddf75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553183 expref: 12 pid: 8756 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.712697:0:8756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8756:1875387796816768:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509474.712725:0:8756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.712738:0:8756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.712745:0:8756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.712757:0:8756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.712765:0:8756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.712801:0:8756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788509474.713688:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875387796816640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12871us (13029us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788509474.713700:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1788509474.713761:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcc87eb9180/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788509474.713772:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796816640:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788509474.713933:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509474.713942:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.713962:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509474.713966:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.713987:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.714007:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.714015:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.714049:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509474.714051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509474.714054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788509474.717486:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788509474.717821:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1788509474.718454:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774730752:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 10137us (13565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.718468:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788509474.724642:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.724786:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774731136 00000100:00100000:2.0:1788509474.724800:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774731136 00000100:00100000:2.0:1788509474.724952:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:2.0:1788509474.724966:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11396:x1875387774731136:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788509474.725044:0:9006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509474.725080:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755321d expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.725103:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.725110:0:9006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509474.725587:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.725616:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.725629:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788509474.725792:0:9006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecd60002 reply state 000000004158e77b transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.725807:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.725815:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.725818:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788509474.725822:0:9006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788509474.726058:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11396:x1875387774731136:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1090us (1425us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788509474.726068:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:0.0:1788509474.728731:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.729132:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774731264 00000100:00100000:3.0:1788509474.729145:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774731264 00000100:00100000:3.0:1788509474.729398:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788509474.729409:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774731264:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788509474.729585:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788509474.729598:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788509473 00002000:00010000:3.0:1788509474.729601:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788509473 00002000:00010000:3.0:1788509474.729603:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788509474 -> 1788509473 00002000:00010000:3.0:1788509474.729606:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788509474.729678:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774731264:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 271us (959us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788509474.729686:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788509474.733646:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.733788:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774731520 00000100:00100000:3.0:1788509474.733803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774731520 00000100:00100000:3.0:1788509474.734281:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788509474.734296:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:11396:x1875387774731520:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788509474.734403:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.734425:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.734438:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.734482:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.734506:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.734549:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796816896:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509474.734671:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509474.739099:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.740331:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774731648 00000100:00100000:2.0:1788509474.740341:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796816896:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509474.740344:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774731648 00010000:00010000:2.0:1788509474.740377:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.740396:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 18 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.740442:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788509474.740458:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2408:x1875387774731648:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509474.740480:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509474.740488:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 18 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.740502:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 18 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.740531:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de190 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755320f expref: 18 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.740550:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:1.0:1788509474.740555:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.740568:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.740577:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.740638:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509474.740656:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.740663:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.740716:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:2408:x1875387774731648:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 264us (1630us total) trans 0 rc 0/0 00010000:00010000:2.0:1788509474.740724:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.740724:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00010000:00010000:2.0:1788509474.740731:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.740738:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.740745:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.740749:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.740757:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.740768:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.740771:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788509474.740775:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.740782:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de1d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.740828:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11396:x1875387774731520:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 6537us (7198us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788509474.740837:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:0.0:1788509474.746475:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.746653:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774731776 00000100:00100000:3.0:1788509474.746666:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774731776 00000100:00100000:3.0:1788509474.746768:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788509474.746781:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774731776:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788509474.746842:0:8756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.746879:0:8756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.746890:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509474.746895:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509474.746921:0:8756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.746978:0:8756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.746994:0:8756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 7 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.747010:0:8756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8756:1875387796817024:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509474.747382:0:8756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509474.750677:0:8756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8756:1875387796817024:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509474.750716:0:8756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.752556:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.752778:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774731904 00000100:00100000:1.0:1788509474.752793:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774731904 00010000:00010000:1.0:1788509474.752858:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 8 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.752940:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1788509474.752952:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774731904:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509474.752972:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509474.753000:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 8 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.753017:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 8 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.753045:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb367d5e/0xe5156b86310de1ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755322b expref: 8 pid: 8437 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.753078:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509474.753083:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509474.753090:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.753429:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.753464:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509474.754625:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774731904:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1663us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.754641:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00010000:00010000:3.0:1788509474.755865:0:8756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.755886:0:8756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.756360:0:8756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.756375:0:8756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.756385:0:8756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.756393:0:8756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509474.756398:0:8756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.756410:0:8756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.756466:0:8756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.756475:0:8756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f27f59f0/0xe5156b86310de1dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.757780:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774731776:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 10988us (11306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509474.757796:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788509474.763470:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.763628:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774732160 00000100:00100000:1.0:1788509474.763641:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774732160 00000100:00100000:1.0:1788509474.763722:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:1.0:1788509474.763735:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:11396:x1875387774732160:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788509474.763840:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.763864:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.763877:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.763970:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509474.763987:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 16 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509474.764004:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ec7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796817152:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509474.764127:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788509474.768580:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509474.768740:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ec7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796817152:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509474.768778:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.770221:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774732288 00000100:00100000:2.0:1788509474.770238:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774732288 00010000:00010000:0.0:1788509474.770394:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.770504:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:0.0:1788509474.770516:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:2408:x1875387774732288:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509474.770535:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509474.770543:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.770558:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.770587:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de0d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531d7 expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.770621:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509474.770627:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 16 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.770638:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.770646:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.770655:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.770726:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509474.770806:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:2408:x1875387774732288:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 292us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509474.770821:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00010000:00010000:2.0:1788509474.772482:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.772772:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.773459:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.773483:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.773494:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.773624:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.773642:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 16 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.773661:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796817280:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509474.773780:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509474.779322:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.779495:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796817280:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509474.779825:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774732416 00000100:00100000:3.0:1788509474.779835:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774732416 00010000:00010000:3.0:1788509474.779917:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.779979:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1788509474.779990:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:2408:x1875387774732416:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509474.780008:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509474.780015:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.780030:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.780058:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de19e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553216 expref: 17 pid: 6520 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.780081:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:3.0:1788509474.780087:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.780115:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.780124:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.780145:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509474.780222:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:2408:x1875387774732416:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 233us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509474.780230:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00010000:00010000:2.0:1788509474.780300:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.780312:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.780318:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788509474.780808:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788509474.781789:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788509474.782279:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788509474.782387:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1875387796817408:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788509474.782611:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509474.782704:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788509474.782755:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796817408 00000100:00100000:1.0:1788509474.782765:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796817408 00000100:00100000:1.0:1788509474.782858:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788509474.782875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1875387796817408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788509474.783038:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1875387796817408:12345-0@lo:1000:mdt00_001.0 Request processed in 171us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509474.783046:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788509474.783175:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788509474.783182:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788509474.783211:0:6521:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bcc87eb9180 x1875387796816640/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788509490 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509474.783225:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1875387796817408:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788509474.783363:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788509474.783437:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1875387796817536:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788509474.783483:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509474.784357:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1788509474.784394:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796817536 00000100:00100000:3.0:1788509474.784402:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796817536 00000100:00100000:3.0:1788509474.784573:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788509474.784584:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1875387796817536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788509474.784820:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1875387796817536:12345-0@lo:1000:mdt00_001.0 Request processed in 238us (1336us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788509474.784829:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788509474.785557:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1875387796817536:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788509474.785636:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785648:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785657:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785663:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2e00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.785670:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785699:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785720:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509474.785723:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509474.785729:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785737:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1eb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785773:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785780:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785786:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785791:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.785794:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785799:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785807:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.785810:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509474.785817:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 19 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785842:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 19 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.785852:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 19 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.790774:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 19 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.790809:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796817664:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788509474.790958:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea480 going to sleep for 11 seconds 00000100:00100000:1.0:1788509474.801813:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.801944:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774732544 00000100:00100000:2.0:1788509474.801957:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774732544 00000100:00100000:2.0:1788509474.802023:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1788509474.802035:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:11395:x1875387774732544:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:2.0:1788509474.802215:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:11395:x1875387774732544:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 181us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.802223:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1788509474.803245:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796817664:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788509474.803287:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803301:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de12e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803347:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803364:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803378:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803390:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803397:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803405:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803441:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509474.803447:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803456:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803469:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509474.803473:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509474.803476:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803482:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de1f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803492:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803507:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803514:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803519:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073e00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509474.803522:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803528:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803548:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509474.803550:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788509474.803553:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.803559:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de1e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509474.803814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11396:x1875387774732160:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 40080us (40357us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788509474.803824:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000020:00080000:0.0:1788509474.803829:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788509474.807146:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509474.807160:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509474.807720:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788509474.807735:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788509474.811032:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509474.811238:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774732800 00000100:00100000:0.0:1788509474.811253:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774732800 00000100:00100000:0.0:1788509474.811332:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:0.0:1788509474.811345:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11395:x1875387774732800:12345-192.168.203.12@tcp:58:lfs.0 00000040:00080000:0.0:1788509474.811603:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788509474.811697:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11395:x1875387774732800:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 354us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509474.811706:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:1.0:1788509474.815727:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.815942:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774733056 00000100:00100000:2.0:1788509474.815955:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774733056 00000100:00100000:2.0:1788509474.816031:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1788509474.816043:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:11396:x1875387774733056:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788509474.816692:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788509474.816732:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788509474.817038:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.817061:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.817076:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.817102:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.817175:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.817183:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.817249:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788509474.817367:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:11396:x1875387774733056:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1324us (1652us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788509474.817377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000020:00080000:2.0:1788509474.817390:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788509474.823619:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509474.823642:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.823682:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2e00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509474.823689:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.823700:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.823724:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:0.0:1788509474.823728:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788509474.823734:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.823742:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de1f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509474.823766:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509474.823768:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509474.823771:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509474.842367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509474.842502:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774733184 00000100:00100000:2.0:1788509474.842516:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774733184 00000100:00100000:2.0:1788509474.842585:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:2.0:1788509474.842607:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:11398:x1875387774733184:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509474.842639:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509474.842668:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de200 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553232 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.842752:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.842772:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.842790:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.842826:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.842835:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.842843:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.847025:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.847064:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.847074:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.847133:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.847153:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 22 pid: 6521 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509474.847172:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796817792:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509474.847287:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea780 going to sleep for 11 seconds 00000100:00100000:2.0:1788509474.853235:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796817792:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509474.853279:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.854519:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509474.854702:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774733440 00000100:00100000:1.0:1788509474.854712:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774733440 00000100:00100000:1.0:1788509474.854780:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788509474.854791:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:6179:x1875387774733440:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788509474.855101:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:6179:x1875387774733440:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 310us (588us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788509474.855109:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788509474.858035:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509474.858179:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774733568 00000100:00100000:3.0:1788509474.858191:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774733568 00010000:00010000:3.0:1788509474.858241:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 24 pid: 6521 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509474.858289:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1788509474.858301:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:2407:x1875387774733568:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509474.858319:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509474.858344:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 24 pid: 6521 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.858361:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 24 pid: 6521 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.858389:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de120 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475531f3 expref: 24 pid: 6521 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.858410:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:3.0:1788509474.858416:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.858429:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.858439:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509474.858473:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509474.858546:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:2407:x1875387774733568:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 247us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509474.858554:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00010000:00010000:2.0:1788509474.858771:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.858782:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509474.858847:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788509474.858853:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509474.858878:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.858894:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.858947:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.858955:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.858963:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.858969:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.858974:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.858982:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.858993:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:2.0:1788509474.859006:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.859011:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859018:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de207 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859031:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859037:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859044:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859049:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509474.859052:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859058:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859064:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8bcdbd047800) 00010000:00010000:2.0:1788509474.859066:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509474.859069:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859074:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de20e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859114:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de200 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553232 expref: 23 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859141:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553232 expref: 22 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509474.859148:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:2.0:1788509474.859150:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509474.859153:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3600, rc 0) 00000100:00100000:2.0:1788509474.859188:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11398:x1875387774733184:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 16585us (16834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509474.859196:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00000040:00080000:2.0:1788509475.639365:0:14261:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788509475.639375:0:14261:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788509475.639406:0:14261:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788509475.639413:0:14261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788509475.734035:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788509475.864218:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509475.864229:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509475.864254:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788509475.864263:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788509475.864395:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796817920:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788509475.864506:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83748000 going to sleep for 11 seconds 00000100:00100000:0.0:1788509475.875317:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796817920:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788509475.877490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509475.877971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774733696 00000100:00100000:0.0:1788509475.877980:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774733696 00000100:00100000:0.0:1788509475.878040:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:0.0:1788509475.878050:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11410:x1875387774733696:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788509475.878109:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788509475.878237:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11410:x1875387774733696:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 187us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509475.878245:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:1.0:1788509475.886380:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509475.886551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774733952 00000100:00100000:0.0:1788509475.886560:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774733952 00000100:00100000:0.0:1788509475.886631:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:0.0:1788509475.886641:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:11410:x1875387774733952:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788509475.886662:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509475.886683:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de21c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553239 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.886782:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de223 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.886808:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.886824:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509475.886836:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788509475.887123:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de21c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553239 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.887142:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de223 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553239 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.887169:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509475.887172:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509475.887176:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a400, rc 0) 00000100:00100000:0.0:1788509475.887225:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:11410:x1875387774733952:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 585us (853us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788509475.887233:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:1.0:1788509475.893885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509475.894266:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774734080 00000100:00100000:0.0:1788509475.894276:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774734080 00000100:00100000:0.0:1788509475.894351:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788509475.894361:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:2408:x1875387774734080:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509475.894376:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509475.894400:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de223 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553239 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.894419:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509475.894424:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509475.894475:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:2408:x1875387774734080:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 115us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509475.894483:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788509475.895604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509475.896102:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774734336 00000100:00100000:0.0:1788509475.896109:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774734336 00000100:00100000:0.0:1788509475.896152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:0.0:1788509475.896161:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:11410:x1875387774734336:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788509475.896231:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896262:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896273:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896544:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896553:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896560:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896565:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ac00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509475.896569:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896576:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896597:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509475.896600:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788509475.896604:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509475.896611:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de231 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509475.896737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:11410:x1875387774734336:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 575us (1136us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788509475.896752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000040:00080000:2.0:1788509475.896755:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788509475.896759:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788509475.897294:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788509475.897304:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788509475.906598:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509475.906890:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774734592 00000100:00100000:1.0:1788509475.906936:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774734592 00000100:00100000:1.0:1788509475.906995:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:1.0:1788509475.907019:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:11410:x1875387774734592:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788509475.907249:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:11410:x1875387774734592:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 232us (668us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788509475.907256:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1788509476.566822:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509476.566848:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796818048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509476.566938:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509476.567233:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796818048 00000100:00100000:1.0:1788509476.567241:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796818048 00000100:00100000:1.0:1788509476.567295:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788509476.567305:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796818048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509476.567336:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509476.567403:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796818048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509476.567411:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788509476.567546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796818048:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788509476.758356:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509477.078188:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509477.078208:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796818176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509477.078272:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509477.078327:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796818304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509477.078360:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509477.078394:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796818304 00000100:00100000:3.0:1788509477.078399:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796818304 00000100:00100000:3.0:1788509477.078448:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788509477.078456:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796818304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509477.078483:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509477.078518:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796818304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509477.078524:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788509477.078562:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796818304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509477.078648:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796818176 00000100:00100000:0.0:1788509477.078652:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796818176 00000100:00100000:0.0:1788509477.078686:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788509477.078692:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796818176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509477.078713:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788509477.078748:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796818176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.078754:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788509477.078778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796818176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509477.078861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796818816:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.078882:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.078922:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796819328:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.078943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.078960:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788509477.078965:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796818432:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.078986:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079002:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796818944:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079033:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796819456:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079050:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079069:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796818816 00000100:00100000:0.0:1788509477.079072:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796818816 00000100:00100000:0.0:1788509477.079098:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788509477.079102:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796818816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079134:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796818816:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788509477.079153:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796819328 00000100:00100000:0.0:1788509477.079156:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796819328 00000100:00100000:0.0:1788509477.079179:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788509477.079184:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1875387796819328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079208:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1875387796819328:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079214:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788509477.079228:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796818432 00000100:00100000:0.0:1788509477.079231:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796818432 00000100:00100000:0.0:1788509477.079250:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788509477.079256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796818432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079278:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796818432:12345-0@lo:400:kworker.0 Request processed in 22us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079283:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788509477.079304:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796818944 00000100:00100000:0.0:1788509477.079307:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796818944 00000100:00100000:0.0:1788509477.079327:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796819456 00000100:00100000:0.0:1788509477.079330:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796819456 00000100:00100000:0.0:1788509477.079347:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788509477.079353:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796818944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079377:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796818944:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079391:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788509477.079401:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788509477.079407:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796819456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079428:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796819456:12345-0@lo:400:kworker.0 Request processed in 21us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079433:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788509477.079460:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796818560:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079480:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079493:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796819072:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079509:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079518:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796819584:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079535:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079546:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788509477.079551:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796818688:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079567:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079590:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796819200:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079608:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079621:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796819712:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079636:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.079654:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796819200 00000100:00100000:0.0:1788509477.079657:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796819200 00000100:00100000:0.0:1788509477.079675:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796819712 00000100:00100000:0.0:1788509477.079677:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796819712 00000100:00100000:0.0:1788509477.079692:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788509477.079697:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796819200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079730:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796819200:12345-0@lo:400:kworker.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079736:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788509477.079746:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788509477.079751:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796819712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079770:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796819712:12345-0@lo:400:kworker.0 Request processed in 19us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079775:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788509477.079790:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796818560 00000100:00100000:0.0:1788509477.079793:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796818560 00000100:00100000:0.0:1788509477.079805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796819072 00000100:00100000:0.0:1788509477.079807:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796819072 00000100:00100000:0.0:1788509477.079815:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796819584 00000100:00100000:0.0:1788509477.079817:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796819584 00000100:00100000:0.0:1788509477.079826:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796818688 00000100:00100000:0.0:1788509477.079828:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796818688 00000100:00100000:0.0:1788509477.079839:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788509477.079844:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796818560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079866:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796818560:12345-0@lo:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079872:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788509477.079880:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788509477.079885:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796819072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079922:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796819072:12345-0@lo:400:kworker.0 Request processed in 37us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788509477.079937:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788509477.079948:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796819584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.079971:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796819584:12345-0@lo:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.079976:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788509477.079985:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788509477.079990:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796818688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080009:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796818688:12345-0@lo:400:kworker.0 Request processed in 19us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.080014:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788509477.080047:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796818432:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080057:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796818944:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080065:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796819456:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080073:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796818816:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080082:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796819328:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080108:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796818688:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080115:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796819200:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080122:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788509477.080126:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1788509477.080139:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcd87c6f480, transno 4294967302 00000004:00080000:0.0:1788509477.080149:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788509477.080157:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcc87ec5880, transno 4294967305 00000100:00100000:0.0:1788509477.080161:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796819712:0@lo:400:kworker.0 00000100:00100000:0.0:1788509477.080179:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796818560:0@lo:400:kworker.0 00010000:00080000:0.0:1788509477.080188:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87ea8700 x1875387796819072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509477.080198:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796819072:0@lo:400:kworker.0 00010000:00080000:0.0:1788509477.080206:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87eaaa00 x1875387796819584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509477.080214:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796819584:0@lo:400:kworker.0 00000100:00080000:0.0:1788509477.080353:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509477.080358:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509477.080360:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509477.080362:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509477.081509:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509477.081525:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796819840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509477.081592:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.081635:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796819840 00000100:00100000:0.0:1788509477.081642:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796819840 00000100:00100000:0.0:1788509477.081680:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788509477.081689:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796819840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509477.081706:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509477.081747:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796819840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.081753:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788509477.081794:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796819840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509477.590742:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796819968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509477.590813:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.590879:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796819968 00000100:00100000:0.0:1788509477.590886:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796819968 00000100:00100000:0.0:1788509477.590939:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788509477.590947:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796819968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509477.590973:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000004:00080000:3.0:1788509477.592386:0:8755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374753485886ns, next at 375753483326ns, rc = 0 00000100:00100000:0.0:1788509477.592593:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796819968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1644us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.592604:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788509477.592644:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796820096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509477.592691:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509477.592739:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796820096 00000100:00100000:0.0:1788509477.592746:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796820096 00000100:00100000:0.0:1788509477.592775:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788509477.592782:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875387796820096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509477.592799:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788509477.592834:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875387796820096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.592840:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788509477.592874:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796820096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509477.594505:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796819968:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788509477.647203:0:14312:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788509477.647213:0:14312:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788509477.647982:0:14312:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788509477.647992:0:14312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788509477.782629:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509477.843998:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509477.844116:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774734848 00000100:00100000:0.0:1788509477.844127:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774734848 00000100:00100000:0.0:1788509477.844203:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:0.0:1788509477.844213:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:11431:x1875387774734848:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509477.844249:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509477.844269:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de238 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553240 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.844385:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310de23f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.844400:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310de23f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.844414:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310de23f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509477.844425:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788509477.844524:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de238 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553240 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.844543:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310de23f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553240 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.844552:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509477.844555:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788509477.844559:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b000, rc 0) 00000100:00100000:0.0:1788509477.844627:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:11431:x1875387774734848:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 415us (648us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788509477.844635:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00080000:3.0:1788509477.844780:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509477.851887:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509477.852019:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774734976 00000100:00100000:0.0:1788509477.852029:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774734976 00000100:00100000:0.0:1788509477.852089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:0.0:1788509477.852110:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:11431:x1875387774734976:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788509477.852171:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852349:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852370:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852408:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852415:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852421:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852427:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590bc00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509477.852431:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852438:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852448:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:0.0:1788509477.852511:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509477.852517:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509477.852524:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de24d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509477.852647:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:11431:x1875387774734976:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 537us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509477.852654:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:1.0:1788509477.984681:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509477.985377:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774735104 00000100:00100000:3.0:1788509477.985387:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774735104 00000100:00100000:3.0:1788509477.985473:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788509477.985483:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774735104:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1788509477.985503:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509477.985523:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de254 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553247 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509477.985547:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9a7d21, atime: 0x6a9a7d21, ctime: 0x6a9a7d21, blocks: 0x8 00010000:00010000:3.0:1788509477.985585:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1788509477.985590:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509477.985599:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de254 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553247 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509477.985618:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de254 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553247 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509477.985631:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030600, rc 0) 00000100:00100000:3.0:1788509477.985687:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2410:x1875387774735104:12345-192.168.203.12@tcp:101:cat.0 Request processed in 205us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509477.985694:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00080000:1.0:1788509477.985841:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509477.995655:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509477.995816:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774735232 00000100:00100000:2.0:1788509477.995825:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774735232 00002000:00100000:2.0:1788509477.995882:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8bcdb7a26300 x1875387774735232/t0(0) o3->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:558/0 lens 488/0 e 0 to 0 dl 1788509488 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788509477.995931:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcdb7a26300 with x1875387774735232 ext(0->4095) 00002000:00010000:2.0:1788509477.995937:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcdb7a26300 00000100:00100000:2.0:1788509477.995964:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788509477.995975:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774735232:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:2.0:1788509477.996177:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774735232:12345-192.168.203.12@tcp:3:cat.0 Request processed in 202us (529us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788509477.996186:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:2.0:1788509477.996192:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8bcdb7a26300 x1875387774735232/t0(0) o3->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:558/0 lens 488/4536 e 0 to 0 dl 1788509488 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788509477.996200:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcdb7a26300 with x1875387774735232 ext(0->4095) 00002000:00010000:2.0:1788509477.996204:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcdb7a26300 00000100:00100000:3.0:1788509478.172004:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509478.172041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509478.172090:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509478.172142:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509478.172180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509478.172186:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774735488 00000100:00100000:1.0:1788509478.172206:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774735488 00000100:00100000:3.0:1788509478.172225:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774735616 00000100:00100000:3.0:1788509478.172236:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774735616 00000100:00100000:2.0:1788509478.172261:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774735360 00000100:00100000:2.0:1788509478.172270:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774735360 00000100:00100000:1.0:1788509478.172314:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774735744 00000100:00100000:3.0:1788509478.172318:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1788509478.172321:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774735744 00000100:00100000:2.0:1788509478.172327:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 381 00000100:00100000:3.0:1788509478.172338:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774735616:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509478.172347:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774735360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509478.172431:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774735360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509478.172439:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 381 00000100:00100000:0.0:1788509478.172822:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774735872 00000100:00100000:0.0:1788509478.172827:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774735872 00000100:00100000:0.0:1788509478.173246:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:0.0:1788509478.173253:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774735488:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509478.173297:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774735488:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509478.173305:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:0.0:1788509478.173333:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 296 00000100:00100000:0.0:1788509478.173338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774735872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509478.173364:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774735872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509478.173370:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 296 00000100:00080000:0.0:1788509478.173399:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509478.173404:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509478.175254:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 297 00000100:00080000:2.0:1788509478.175650:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509478.176533:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774735744:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509478.176774:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774735744:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1508us (4730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509478.176784:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 297 00000100:00100000:3.0:1788509478.178169:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774735616:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 5824us (6012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509478.178187:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00010000:00010000:0.0:1788509478.808116:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509479.830173:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788509480.022127:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509480.022137:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509480.022158:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788509480.022168:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788509480.278533:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788509480.668629:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1788509480.668661:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788509480.669609:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:0.0:1788509480.669626:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788509480.669672:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bcc87767c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788509480.669689:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcd8338e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bcc877676c0 00000020:00080000:0.0:1788509480.669693:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcd8338e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bcdb78e0000 00000020:00080000:0.0:1788509480.669719:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:3.0:1788509480.669858:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788509480.669893:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796820224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788509480.670023:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509480.670180:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796820224 00000100:00100000:3.0:1788509480.670188:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796820224 00000100:00100000:3.0:1788509480.670256:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788509480.670267:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796820224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788509480.670718:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788509480.670723:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788509473 -> 1788509473 00002000:00010000:3.0:1788509480.670726:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788509473 -> 1788509473 00002000:00010000:3.0:1788509480.670728:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788509473 -> 1788509473 00002000:00010000:3.0:1788509480.670730:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788509480.670796:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796820224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 530us (772us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788509480.670805:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788509480.670834:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509480.670874:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788509480.670880:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcc87eb9180, transno 4294967310 00010000:00010000:1.0:1788509480.670998:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509480.671010:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509480.671019:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509480.671025:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509480.671031:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509480.671041:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509480.671064:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:1.0:1788509480.671068:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509480.671074:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509480.671081:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de1cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788509480.672023:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788509480.672128:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000004:00080000:3.0:1788509480.672302:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788509480.672533:0:3646:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bcc87eb8a80 x1875387796820224/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788509496 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788509480.672559:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcc87eb8a80/2, rc 0, transno 4294967313 00000100:00100000:3.0:1788509480.672566:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796820224:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788509480.855225:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509481.686294:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509481.686334:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796820352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509481.686414:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509481.686603:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796820352 00000100:00100000:3.0:1788509481.686613:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796820352 00000100:00100000:3.0:1788509481.686668:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788509481.686678:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796820352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509481.686711:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509481.687188:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796820352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 509us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509481.687197:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788509481.687315:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796820352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788509481.879074:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509482.198031:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509482.198055:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796820480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509482.198140:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509482.198207:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796820480 00000100:00100000:3.0:1788509482.198214:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796820480 00000100:00100000:3.0:1788509482.198271:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788509482.198282:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796820480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509482.198312:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509482.198356:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796820480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509482.198363:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788509482.198385:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509482.198422:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796820480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509482.203316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796820736:0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.203395:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509482.203649:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796820864:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.203686:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509482.203710:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796821376:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.203733:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509482.203750:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796821888:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.203773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509482.203791:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788509482.203796:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796820992:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.203816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509482.203832:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796821504:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.203852:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509482.203868:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796822016:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.203888:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509482.203964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796820864 00000100:00100000:2.0:1788509482.203972:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796820864 00000100:00100000:2.0:1788509482.204014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796821504 00000100:00100000:2.0:1788509482.204018:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796821504 00000100:00100000:2.0:1788509482.204040:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796822016 00000100:00100000:2.0:1788509482.204044:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796822016 00000100:00100000:2.0:1788509482.204075:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788509482.204084:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796820864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796820864:12345-0@lo:400:kworker.0 Request processed in 53us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.204157:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788509482.204175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788509482.204182:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796821504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204210:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796821504:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.204216:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788509482.204228:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788509482.204233:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796822016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204259:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796822016:12345-0@lo:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.204264:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788509482.204282:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796821888 00000100:00100000:2.0:1788509482.204286:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796821888 00000100:00100000:2.0:1788509482.204313:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788509482.204319:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796821888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204348:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796821888:12345-0@lo:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.204354:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788509482.204372:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796821376 00000100:00100000:2.0:1788509482.204376:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796821376 00000100:00100000:2.0:1788509482.204397:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796820992 00000100:00100000:2.0:1788509482.204399:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796820992 00000100:00100000:2.0:1788509482.204411:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788509482.204416:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796821376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204448:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796821376:12345-0@lo:400:kworker.0 Request processed in 31us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.204464:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788509482.204479:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788509482.204485:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796820992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204515:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796820992:12345-0@lo:400:kworker.0 Request processed in 30us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.204521:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788509482.204587:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796820992:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796821504:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204608:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796822016:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204618:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796820864:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204626:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796821376:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.204637:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796821888:0@lo:400:kworker.0 00000100:00080000:2.0:1788509482.204681:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509482.204686:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509482.208762:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796820736 00000100:00100000:2.0:1788509482.208777:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796820736 00000100:00100000:2.0:1788509482.208841:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788509482.208850:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796820736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.208954:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796820736:12345-0@lo:400:kworker.0 Request processed in 105us (5559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.208961:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788509482.209087:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788509482.209117:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796821248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509482.209153:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509482.209180:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796821248 00000100:00100000:0.0:1788509482.209184:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796821248 00000100:00100000:0.0:1788509482.209225:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788509482.209232:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796821248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509482.209249:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509482.209279:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796821248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509482.209285:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788509482.209327:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796821248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509482.209334:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796821760:0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209360:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509482.209378:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796822272:0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209397:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509482.209415:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796820608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509482.209437:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509482.209453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796821120:0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209495:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509482.209510:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796821632:0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509482.209556:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796822144:0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209577:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509482.209598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796820736:0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209651:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796821760 00000100:00100000:0.0:1788509482.209655:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796821760 00000100:00100000:0.0:1788509482.209678:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796822272 00000100:00100000:0.0:1788509482.209681:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796822272 00000100:00100000:0.0:1788509482.209694:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788509482.209700:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796821760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209733:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796821760:12345-0@lo:400:kworker.0 Request processed in 33us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509482.209739:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788509482.209748:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788509482.209753:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796822272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209775:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796822272:12345-0@lo:400:kworker.0 Request processed in 22us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509482.209780:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788509482.209800:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796821760:0@lo:400:kworker.0 00000100:00100000:0.0:1788509482.209808:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796822272:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.209952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796820608 00000100:00100000:2.0:1788509482.209956:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796820608 00000100:00100000:2.0:1788509482.209992:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788509482.209998:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796820608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509482.210022:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788509482.210067:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796820608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.210073:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788509482.210092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796821120 00000100:00100000:2.0:1788509482.210095:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796821120 00000100:00100000:2.0:1788509482.210114:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796821632 00000100:00100000:2.0:1788509482.210117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796821632 00000100:00100000:2.0:1788509482.210128:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796822144 00000100:00100000:2.0:1788509482.210130:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796822144 00000100:00100000:2.0:1788509482.210142:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788509482.210148:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796821120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.210178:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796821120:12345-0@lo:400:kworker.0 Request processed in 30us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.210184:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788509482.210196:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788509482.210201:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796821632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.210229:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796821632:12345-0@lo:400:kworker.0 Request processed in 28us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.210235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788509482.210244:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788509482.210250:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796822144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.210270:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796822144:12345-0@lo:400:kworker.0 Request processed in 21us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509482.210275:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:2.0:1788509482.210310:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509482.210314:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509482.210316:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509482.210457:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796820608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509482.210468:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796821120:0@lo:400:kworker.0 00010000:00080000:0.0:1788509482.210489:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87ea7b80 x1875387796821632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509482.210498:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796821632:0@lo:400:kworker.0 00010000:00080000:0.0:1788509482.210507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8119c380 x1875387796822144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509482.210516:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796822144:0@lo:400:kworker.0 00000100:00100000:2.0:1788509482.710374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796822400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509482.710441:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509482.710606:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796822400 00000100:00100000:1.0:1788509482.710614:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796822400 00000100:00100000:1.0:1788509482.710668:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788509482.710677:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796822400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788509482.710702:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788509482.710753:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796822400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509482.710773:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788509482.710872:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796822400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509482.711055:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509482.711064:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796822528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509482.711090:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509482.711197:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796822528 00000100:00100000:3.0:1788509482.711202:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796822528 00000100:00100000:3.0:1788509482.711233:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788509482.711240:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796822528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509482.711250:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788509482.711288:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796822528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509482.711294:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788509482.711358:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796822528:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788509482.912162:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509483.275728:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509483.278848:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774736000 00000100:00100000:0.0:1788509483.278861:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774736000 00000100:00100000:2.0:1788509483.279171:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:2.0:1788509483.279184:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:11084:x1875387774736000:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788509483.279301:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:11084:x1875387774736000:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 120us (3581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509483.279321:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00080000:0.0:1788509483.283834:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509483.285990:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509483.286029:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509483.286109:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509483.286131:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509483.286149:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509483.286214:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774736640 00000100:00100000:1.0:1788509483.286223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774736640 00000100:00100000:1.0:1788509483.286280:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774736256 00000100:00100000:1.0:1788509483.286284:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774736256 00000100:00100000:1.0:1788509483.286320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 304 00000100:00100000:1.0:1788509483.286330:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774736640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509483.286412:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774736640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509483.286420:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 304 00000100:00100000:1.0:1788509483.286451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 305 00000100:00100000:1.0:1788509483.286458:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774736256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509483.286497:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774736256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509483.286504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 305 00000100:00080000:1.0:1788509483.286523:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509483.286527:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509483.287047:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774736128 00000100:00100000:2.0:1788509483.287053:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774736128 00000100:00100000:2.0:1788509483.287099:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 383 00000100:00100000:2.0:1788509483.287107:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774736128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509483.287139:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd8768b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774736128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509483.287145:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 383 00000100:00100000:0.0:1788509483.292292:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509483.292331:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509483.292377:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774736768 00000100:00100000:0.0:1788509483.292386:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774736768 00000100:00100000:0.0:1788509483.292443:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774736896 00000100:00100000:0.0:1788509483.292447:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774736896 00000100:00100000:0.0:1788509483.292465:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 306 00000100:00100000:0.0:1788509483.292891:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774736768:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509483.292982:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774736768:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509483.293026:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774736384 00000100:00100000:3.0:1788509483.293031:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774736384 00000100:00100000:3.0:1788509483.293075:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774736512 00000100:00100000:3.0:1788509483.293078:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774736512 00000100:00100000:3.0:1788509483.293099:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:3.0:1788509483.293106:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774736384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509483.293132:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774736384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (7103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509483.293139:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:3.0:1788509483.293154:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1788509483.293160:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774736512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509483.293181:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774736512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (7031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509483.293187:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788509483.297147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:1.0:1788509483.297185:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:11084:x1875387774736896:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788509483.297296:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:11084:x1875387774736896:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 130us (4963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509483.297305:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00080000:1.0:1788509483.297590:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788509483.297596:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509483.297598:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509483.302060:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 306 00000100:00100000:2.0:1788509483.312023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509483.312116:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774737152 00000100:00100000:3.0:1788509483.312125:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774737152 00000100:00100000:3.0:1788509483.312593:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788509483.312605:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:11084:x1875387774737152:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788509483.312876:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:11084:x1875387774737152:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 273us (861us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788509483.312884:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788509483.691055:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509483.691621:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774737280 00000100:00100000:2.0:1788509483.691644:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774737280 00000100:00100000:2.0:1788509483.691705:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:2.0:1788509483.691716:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:11891:x1875387774737280:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:2.0:1788509483.691737:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509483.691768:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de25b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755324e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509483.691831:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509483.691845:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509483.691857:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509483.696170:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788509483.696180:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509483.696233:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509483.696273:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de25b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509483.696294:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509483.696303:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:2.0:1788509483.696306:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788509483.696309:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2000, rc 0) 00000100:00100000:2.0:1788509483.699891:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:11891:x1875387774737280:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 8170us (8838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509483.699919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00010000:00010000:2.0:1788509483.926414:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509484.950146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509485.975793:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788509486.815389:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000100:00100000:1.0:1788509486.817002:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509486.817022:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796822656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509486.817097:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509486.817162:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796822656 00000100:00100000:1.0:1788509486.817169:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796822656 00000100:00100000:1.0:1788509486.817211:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788509486.817218:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796822656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509486.817248:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509486.817286:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796822656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509486.817292:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788509486.817343:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796822656:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788509486.829835:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788509486.829870:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788509486.829952:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788509486.829965:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788509486.998749:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509487.318450:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796822784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509487.318556:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509487.319604:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796822784 00000100:00100000:2.0:1788509487.319618:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796822784 00000100:00100000:2.0:1788509487.319706:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788509487.319719:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796822784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788509487.319762:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788509487.321674:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509487.321788:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796822912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509487.321875:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509487.321980:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509487.321988:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796823040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509487.322018:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509487.322059:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796823040 00000100:00100000:0.0:1788509487.322068:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796823040 00000100:00100000:0.0:1788509487.322122:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788509487.322131:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796823040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509487.322158:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509487.322206:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796823040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509487.322214:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788509487.322240:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796822912 00000100:00100000:0.0:1788509487.322244:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796822912 00000100:00100000:0.0:1788509487.322272:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788509487.322279:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796822912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509487.322310:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788509487.322342:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796822912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509487.322349:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788509487.322368:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509487.322404:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796823040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509487.322417:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796822912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509487.326140:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796822784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6408us (7568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509487.326160:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788509487.326461:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796823168:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.326555:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.326594:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796823680:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.326644:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.326666:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796824192:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.326959:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.326986:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788509487.327076:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796823296:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.327105:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.327127:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796823808:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.327148:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.327165:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796824320:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.327186:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.327212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796823424:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.327237:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.327250:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796823936:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.327275:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.327295:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788509487.327302:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796823552:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.327325:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.327344:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796824064:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.327383:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.327490:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796823680 00000100:00100000:3.0:1788509487.327501:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796823680 00000100:00100000:3.0:1788509487.327571:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796824192 00000100:00100000:3.0:1788509487.327575:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796824192 00000100:00100000:3.0:1788509487.327590:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796823296 00000100:00100000:3.0:1788509487.327592:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796823296 00000100:00100000:3.0:1788509487.327603:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796823808 00000100:00100000:3.0:1788509487.327612:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796823808 00000100:00100000:3.0:1788509487.327630:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796824320 00000100:00100000:3.0:1788509487.327633:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796824320 00000100:00100000:3.0:1788509487.327645:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796823424 00000100:00100000:3.0:1788509487.327647:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796823424 00000100:00100000:3.0:1788509487.327662:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788509487.327672:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796823680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.327837:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796823168 00000100:00100000:2.0:1788509487.327842:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796823168 00000100:00100000:2.0:1788509487.327878:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788509487.327885:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796823168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.327969:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796823168:12345-0@lo:400:kworker.0 Request processed in 84us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509487.327976:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788509487.328155:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788509487.328164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796824192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.328202:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796824192:12345-0@lo:400:kworker.0 Request processed in 40us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509487.328209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788509487.328237:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788509487.328243:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796823296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.328275:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796823296:12345-0@lo:400:kworker.0 Request processed in 33us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509487.328281:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788509487.328292:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788509487.328298:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796823808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.328339:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796823808:12345-0@lo:400:kworker.0 Request processed in 42us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509487.328345:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788509487.328358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788509487.328364:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796824320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.328390:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796824320:12345-0@lo:400:kworker.0 Request processed in 27us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509487.328396:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788509487.328406:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788509487.328552:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796823680:12345-0@lo:400:kworker.0 Request processed in 882us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509487.328559:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788509487.328586:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796823936 00000100:00100000:3.0:1788509487.328591:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796823936 00000100:00100000:3.0:1788509487.328626:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796824064 00000100:00100000:3.0:1788509487.328629:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796824064 00000100:00100000:3.0:1788509487.328650:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788509487.328656:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796823936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.328764:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796823424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.328864:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796823424:12345-0@lo:400:kworker.0 Request processed in 105us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509487.328871:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788509487.328946:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796823296:0@lo:400:kworker.0 00010000:00080000:2.0:1788509487.328963:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7a21c00 x1875387796823808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509487.328975:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796823808:0@lo:400:kworker.0 00010000:00080000:2.0:1788509487.329082:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87364e00 x1875387796824320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509487.329092:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796824320:0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.329104:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796823168:0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.329115:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796823680:0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.329127:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796824192:0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.329179:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788509487.329188:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796824064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.329225:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796824064:12345-0@lo:400:kworker.0 Request processed in 39us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509487.329232:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788509487.329259:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788509487.329266:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcc87eb8a80, transno 4294967313 00000100:00100000:2.0:1788509487.329280:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796824064:0@lo:400:kworker.0 00000100:00100000:2.0:1788509487.329292:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796823424:0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.330130:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796823936:12345-0@lo:400:kworker.0 Request processed in 1467us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509487.330141:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1788509487.330175:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509487.330183:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509487.330185:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509487.330348:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796823936:0@lo:400:kworker.0 00000100:00100000:0.0:1788509487.330576:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796822784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509487.334833:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796823552 00000100:00100000:3.0:1788509487.334854:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796823552 00000100:00100000:3.0:1788509487.334968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788509487.334980:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796823552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509487.335300:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796823552:12345-0@lo:400:kworker.0 Request processed in 321us (7971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509487.335308:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788509487.338599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796823552:0@lo:400:kworker.0 00000001:02000400:3.0:1788509487.686641:0:14510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:11:25 (1788509485) 00000100:00100000:0.0:1788509487.831423:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796824448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509487.831521:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509487.831621:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796824448 00000100:00100000:0.0:1788509487.831630:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796824448 00000100:00100000:0.0:1788509487.831702:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788509487.831713:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796824448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509487.831754:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788509487.831818:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796824448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509487.831826:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788509487.831887:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796824448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509487.834022:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796824576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509487.834105:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509487.834185:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796824576 00000100:00100000:3.0:1788509487.834195:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796824576 00000100:00100000:3.0:1788509487.834252:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788509487.834261:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796824576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788509487.834287:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788509487.834337:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796824576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509487.834343:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788509487.834392:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796824576:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788509488.022186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509488.405124:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509488.408994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509488.409023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509488.409046:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509488.409063:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509488.409080:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509488.409107:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509488.409157:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774737664 00000100:00100000:3.0:1788509488.409170:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774737664 00000100:00100000:1.0:1788509488.409219:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774738176 00000100:00100000:1.0:1788509488.409223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774738176 00000100:00100000:3.0:1788509488.409236:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774737536 00000100:00100000:3.0:1788509488.409238:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774737536 00000100:00100000:1.0:1788509488.409247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774738048 00000100:00100000:1.0:1788509488.409249:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774738048 00000100:00100000:3.0:1788509488.409258:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 313 00000100:00100000:1.0:1788509488.409267:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 314 00000100:00100000:3.0:1788509488.409269:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774737664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509488.409273:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774738176:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509488.409356:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774738176:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509488.409364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 314 00000100:00100000:2.0:1788509488.409372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774737408 00000100:00100000:2.0:1788509488.409378:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774737408 00000100:00100000:1.0:1788509488.409402:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 315 00000100:00100000:2.0:1788509488.409408:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 385 00000100:00100000:1.0:1788509488.409409:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:2408:x1875387774737536:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509488.409414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774737408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509488.409815:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774737664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 546us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509488.409837:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 313 00000100:00100000:3.0:1788509488.409854:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 316 00000100:00100000:3.0:1788509488.409860:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2408:x1875387774738048:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509488.409890:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2408:x1875387774738048:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509488.409924:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 316 00000100:00100000:3.0:1788509488.409953:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774737920 00000100:00100000:3.0:1788509488.409957:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774737920 00000100:00100000:3.0:1788509488.409987:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774737792 00000100:00100000:3.0:1788509488.409990:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774737792 00000100:00100000:3.0:1788509488.410012:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:3.0:1788509488.410019:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774737920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509488.410313:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774737920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 293us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509488.410321:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:3.0:1788509488.410335:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:3.0:1788509488.410342:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774737792:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509488.410388:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774737792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509488.410394:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00080000:3.0:1788509488.410418:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509488.410423:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509488.410426:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509488.410428:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509488.416431:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774737408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 6990us (11306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509488.416450:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 385 00000100:00100000:1.0:1788509488.418195:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:2408:x1875387774737536:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 8770us (9114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509488.418214:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 315 00010000:00010000:2.0:1788509489.047691:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509489.199518:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509489.203756:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774738432 00000100:00100000:0.0:1788509489.203779:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774738432 00000100:00100000:0.0:1788509489.203949:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:0.0:1788509489.203963:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:12158:x1875387774738432:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788509489.203991:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509489.204021:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de269 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553255 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204119:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204139:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204154:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204196:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204217:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204226:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204355:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de27e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204366:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de27e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204373:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de27e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509489.204384:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788509489.204507:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204515:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204522:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204528:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509489.204533:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204551:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204566:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8bcd83aef800) 00010000:00010000:0.0:1788509489.204569:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509489.204575:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204582:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de270 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204599:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204605:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204612:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204617:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509489.204622:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204627:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204634:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8bcc87630f00) 00010000:00010000:0.0:1788509489.204637:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509489.204639:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.204656:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de277 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.205095:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de269 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553255 expref: 16 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.205112:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de27e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553255 expref: 15 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.205120:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:0.0:1788509489.205122:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509489.205125:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a800, rc 0) 00000100:00100000:0.0:1788509489.205215:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:12158:x1875387774738432:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1254us (5711us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788509489.205224:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:3.0:1788509489.211628:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509489.211688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774738560 00000100:00100000:0.0:1788509489.211702:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774738560 00000100:00100000:0.0:1788509489.211784:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:0.0:1788509489.211807:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:12158:x1875387774738560:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788509489.211986:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:12158:x1875387774738560:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 192us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509489.211994:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:3.0:1788509489.212175:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509489.212238:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774738688 00000100:00100000:0.0:1788509489.212244:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774738688 00000100:00100000:0.0:1788509489.212297:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788509489.212306:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:2410:x1875387774738688:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509489.212340:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509489.212372:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de27e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553255 expref: 15 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509489.212396:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:0.0:1788509489.212402:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509489.212426:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:2410:x1875387774738688:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 121us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509489.212433:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788509489.224727:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509489.236393:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774738816 00000100:00100000:0.0:1788509489.236415:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774738816 00000100:00100000:0.0:1788509489.236521:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:0.0:1788509489.236544:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:12158:x1875387774738816:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788509489.236703:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:12158:x1875387774738816:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 161us (11989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509489.236712:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000040:00080000:0.0:1788509489.241507:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509489.241519:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509489.242469:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788509489.242488:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788509489.496355:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788509490.071653:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509490.263936:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788509490.263949:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788509490.264095:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788509490.264103:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788509490.519543:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788509491.094300:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509491.245418:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509491.245514:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774738944 00000100:00100000:2.0:1788509491.245524:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774738944 00000100:00100000:2.0:1788509491.245606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:2.0:1788509491.245618:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:12200:x1875387774738944:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509491.245638:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509491.245658:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de28c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755325c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245728:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245742:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245753:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245766:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245773:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245792:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245834:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245840:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245846:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245853:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509491.245857:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245864:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245876:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:2.0:1788509491.245878:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509491.245883:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245890:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2200/0xe5156b86310de293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245924:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245930:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245943:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245947:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509491.245949:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245956:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245964:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8bcdbd047600) 00010000:00010000:2.0:1788509491.245966:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509491.245969:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.245974:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de29a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.246002:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de28c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755325c expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.246012:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:2.0:1788509491.246015:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509491.246018:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de28c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755325c expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.246026:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2800, rc 0) 00000100:00100000:2.0:1788509491.246080:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:12200:x1875387774738944:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 464us (670us total) trans 0 rc 301/301 00000100:00100000:2.0:1788509491.246095:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00080000:3.0:1788509491.246285:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509491.254055:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.254146:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774739200 00000100:00100000:3.0:1788509491.254157:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774739200 00000100:00100000:3.0:1788509491.254219:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:3.0:1788509491.254229:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+14:12200:x1875387774739200:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1788509491.254296:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509491.254322:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310ddbe0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553080 expref: 14 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.254340:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:3.0:1788509491.254346:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509491.254410:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.254423:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.254431:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.254463:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.254486:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 5 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509491.254515:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796824704:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509491.254600:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788509491.256603:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796824704:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509491.256629:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509491.257314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.258085:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774739328 00000100:00100000:3.0:1788509491.258094:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774739328 00000100:00080000:0.0:1788509491.258225:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788509491.258267:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 6 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509491.258314:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788509491.258323:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2408:x1875387774739328:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509491.258335:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509491.258341:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 6 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.258352:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 6 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.258372:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de262 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755324e expref: 6 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.258385:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:3.0:1788509491.258389:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.258405:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.258412:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.258490:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509491.258548:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774739328:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 225us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509491.258555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00010000:00010000:1.0:1788509491.267939:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.267957:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.267988:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.268002:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.268014:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269691:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269708:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269730:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509491.269749:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014063e4c reply state 0000000026943d5f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269761:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269769:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509491.269772:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509491.269776:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788509491.269781:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788509491.269789:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269796:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269803:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269809:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509491.269823:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269831:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269841:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc865bb500) 00010000:00010000:1.0:1788509491.269844:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509491.269855:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269860:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de2a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509491.269883:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014063e4c reply state 0000000026943d5f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.269891:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.273229:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8bcc8761e100) 00010000:00010000:1.0:1788509491.273236:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509491.273242:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788509491.273401:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:12200:x1875387774739200:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 19169us (19349us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788509491.273410:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:0.0:1788509491.358428:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509491.358468:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774739456 00000100:00100000:0.0:1788509491.358489:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774739456 00000100:00100000:0.0:1788509491.358544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:0.0:1788509491.358555:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+15:12208:x1875387774739456:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:0.0:1788509491.358591:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509491.358614:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de2b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553263 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.358673:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310de2bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.358686:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310de2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.358698:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310de2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509491.358741:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788509491.358745:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509491.358764:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310de2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.358788:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de2b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553263 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.358805:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310de2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553263 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.358812:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:0.0:1788509491.358815:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509491.358818:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590aa00, rc 0) 00000100:00100000:0.0:1788509491.358872:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:12208:x1875387774739456:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 320us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509491.358879:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:0.0:1788509491.427604:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.427707:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774739584 00000100:00100000:1.0:1788509491.427717:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774739584 00000100:00100000:1.0:1788509491.427778:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:1.0:1788509491.427789:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+16:12214:x1875387774739584:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788509491.427808:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509491.427828:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de2c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755326a expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.427894:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.427946:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.427975:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.427987:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.427994:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428000:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428080:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de2d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428088:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428094:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509491.428135:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788509491.428139:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509491.428159:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428171:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428256:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428273:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428279:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509491.428283:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428296:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428310:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:1.0:1788509491.428313:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509491.428317:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428324:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073200/0xe5156b86310de2cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428336:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428342:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428407:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428413:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509491.428416:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428430:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428438:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8bcc8761e100) 00010000:00010000:1.0:1788509491.428440:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509491.428443:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428448:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072a00/0xe5156b86310de2d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428487:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072400/0xe5156b86310de2c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755326a expref: 18 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428501:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755326a expref: 17 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.428507:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509491.428509:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788509491.428512:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdc2073e00, rc 0) 00000100:00100000:2.0:1788509491.428832:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:12214:x1875387774739584:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1042us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509491.428841:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:0.0:1788509491.435978:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.436186:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774739840 00000100:00100000:1.0:1788509491.436197:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774739840 00000100:00100000:1.0:1788509491.436256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:1.0:1788509491.436267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+17:12214:x1875387774739840:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788509491.436287:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509491.436309:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de2e0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553271 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.436432:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.436448:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.436461:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.437832:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.437849:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.437859:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788509491.438223:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788509491.438372:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438381:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438389:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438424:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438448:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438455:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438461:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509491.438465:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438474:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438499:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509491.438502:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509491.438506:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438512:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de2e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509491.438524:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007218a4ba reply state 0000000059cd5d73 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438534:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438540:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761e400) 00010000:00010000:1.0:1788509491.438542:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509491.438545:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788509491.438581:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310de2e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438604:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.438612:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc8761ed00) 00010000:00010000:1.0:1788509491.438615:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509491.438617:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae800, rc 0) 00000100:00100000:1.0:1788509491.438690:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:12214:x1875387774739840:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2424us (2721us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788509491.438698:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:0.0:1788509491.445620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.445718:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774739968 00000100:00100000:3.0:1788509491.445728:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774739968 00000100:00100000:3.0:1788509491.445871:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788509491.445881:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774739968:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788509491.445926:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509491.445947:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553278 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509491.445970:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509491.445989:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1788509491.445994:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509491.446002:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.446022:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.446055:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031a00, rc 0) 00000100:00100000:3.0:1788509491.446122:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774739968:12345-192.168.203.12@tcp:101:bash.0 Request processed in 230us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509491.446135:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00080000:0.0:1788509491.447135:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509491.449543:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.449636:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774740096 00000100:00100000:3.0:1788509491.449645:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774740096 00000100:00100000:3.0:1788509491.449725:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:3.0:1788509491.449735:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:12214:x1875387774740096:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788509491.449752:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509491.449769:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755327f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.449802:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.449878:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509491.449884:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509491.449891:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.449954:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.449967:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 7 pid: 8436 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509491.449995:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875387796824832:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509491.450083:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788509491.453261:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509491.453295:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774740224 00000100:00100000:0.0:1788509491.453304:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774740224 00010000:00010000:0.0:1788509491.453341:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 8 pid: 8436 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509491.453375:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:0.0:1788509491.453643:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774740224:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509491.453660:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509491.453684:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 8 pid: 8436 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.453699:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 8 pid: 8436 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.453721:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509491.453726:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509491.453733:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.453743:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.453798:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509491.453812:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1875387796824960:192.168.203.12@tcp:105: 00010000:00010000:3.0:1788509491.454011:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310de303 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553278 expref: 8 pid: 8436 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509491.454027:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875387796824832:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509491.454050:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.454061:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030800, rc 0) 00000100:00100000:3.0:1788509491.454313:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:12214:x1875387774740096:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4578us (4776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509491.454321:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788509491.454487:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509491.462085:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509491.462599:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1875387796824960:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788509491.462624:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509491.462730:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2408:x1875387774740224:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 9344us (9475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509491.462741:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1788509491.462843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774740480 00000100:00100000:3.0:1788509491.462850:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774740480 00000100:00100000:3.0:1788509491.462927:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1788509491.462936:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:12214:x1875387774740480:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:3.0:1788509491.463659:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12214:x1875387774740480:12345-192.168.203.12@tcp:35:bash.0 Request processed in 720us (1581us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788509491.463668:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1788509491.555409:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.555501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774740736 00000100:00100000:3.0:1788509491.555510:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774740736 00000100:00100000:3.0:1788509491.555571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:3.0:1788509491.555604:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12224:x1875387774740736:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509491.555626:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509491.555644:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553286 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509491.555741:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788509491.555855:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de311 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553286 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.555868:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:3.0:1788509491.555870:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788509491.555875:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553286 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.555889:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031a00, rc 0) 00000100:00100000:3.0:1788509491.556001:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:12224:x1875387774740736:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 400us (602us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788509491.556008:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:0.0:1788509491.566427:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.566543:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774740992 00000100:00100000:1.0:1788509491.566553:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774740992 00000100:00100000:1.0:1788509491.566617:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1788509491.566627:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:12224:x1875387774740992:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509491.567035:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:12224:x1875387774740992:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 408us (617us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788509491.567043:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1788509491.662172:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509491.662330:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774741120 00000100:00100000:0.0:1788509491.662340:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774741120 00000100:00100000:0.0:1788509491.662401:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:0.0:1788509491.662411:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:12230:x1875387774741120:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509491.662432:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509491.662452:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de31f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755328d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.662526:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de326 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.662544:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.662555:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509491.662598:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788509491.662602:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509491.662633:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.662660:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de31f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755328d expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.662678:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de326 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755328d expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.662687:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509491.662690:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509491.662694:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a000, rc 0) 00000100:00100000:0.0:1788509491.662758:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:12230:x1875387774741120:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 349us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509491.662764:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:0.0:1788509491.666406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.666504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774741376 00000100:00100000:3.0:1788509491.666516:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774741376 00000100:00100000:3.0:1788509491.666575:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:3.0:1788509491.666585:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:12230:x1875387774741376:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509491.666604:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509491.666624:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de32d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553294 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.666727:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de334 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.666752:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.666763:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509491.666775:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788509491.666888:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de32d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553294 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.666941:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553294 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.666951:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc8761ed00) 00010000:00010000:3.0:1788509491.666954:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788509491.666957:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030a00, rc 0) 00000100:00100000:3.0:1788509491.667528:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+26:12230:x1875387774741376:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 943us (1128us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788509491.667537:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:2.0:1788509491.676985:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509491.677030:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.677095:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774741760 00000100:00100000:3.0:1788509491.677105:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774741760 00000100:00100000:3.0:1788509491.677179:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788509491.677197:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+26:2408:x1875387774741760:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509491.677212:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509491.677236:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de334 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553294 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.677273:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc8761ed00) 00010000:00010000:3.0:1788509491.677279:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509491.677338:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:2408:x1875387774741760:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 151us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509491.677346:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788509491.678041:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774741632 00000100:00100000:0.0:1788509491.678048:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774741632 00000100:00100000:0.0:1788509491.678091:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:0.0:1788509491.678099:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12230:x1875387774741632:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509491.678119:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509491.678136:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de342 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755329b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.678243:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de349 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.678258:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de349 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.678283:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de349 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509491.678296:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788509491.678405:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de342 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755329b expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.678422:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de349 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755329b expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.678430:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc8761ed00) 00010000:00010000:0.0:1788509491.678433:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788509491.678436:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a800, rc 0) 00000100:00100000:0.0:1788509491.678490:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12230:x1875387774741632:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 391us (1514us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788509491.678497:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:2.0:1788509491.692767:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.693180:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774741888 00000100:00100000:1.0:1788509491.693196:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774741888 00000100:00100000:1.0:1788509491.693257:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788509491.693267:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2409:x1875387774741888:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:1.0:1788509491.693309:0:8756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.693329:0:8756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.693351:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509491.693355:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509491.693360:0:8756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.693392:0:8756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.693405:0:8756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 6 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509491.693419:0:8756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8756:1875387796825088:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509491.693517:0:8756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87c1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788509491.700758:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509491.701117:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774742016 00000100:00100000:0.0:1788509491.701126:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774742016 00002000:00100000:0.0:1788509491.701191:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8bcc87ea4a80 x1875387774742016/t0(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:572/0 lens 504/0 e 0 to 0 dl 1788509502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788509491.701201:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc87ea4a80 with x1875387774742016 ext(0->12) 00010000:00010000:0.0:1788509491.701210:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 7 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.701227:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 7 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788509491.701255:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bcc87ea4a80 00000100:00100000:0.0:1788509491.701289:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788509491.701299:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774742016:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:1.0:1788509491.703446:0:8756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8756:1875387796825088:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509491.703486:0:8756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509491.703748:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774742016:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 2449us (2997us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788509491.703758:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:0.0:1788509491.703770:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8bcc87ea4a80 x1875387774742016/t4294967306(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:572/0 lens 504/448 e 0 to 0 dl 1788509502 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788509491.703779:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc87ea4a80 with x1875387774742016 ext(0->12) 00010000:00010000:0.0:1788509491.703787:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 9 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.703802:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 9 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788509491.703810:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bcc87ea4a80 00000100:00100000:2.0:1788509491.706881:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.707046:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774742144 00000100:00100000:1.0:1788509491.707055:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774742144 00010000:00010000:1.0:1788509491.707092:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 9 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509491.707131:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1788509491.707140:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2409:x1875387774742144:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509491.707179:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788509491.707204:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788509491.707207:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788509490 00002000:00010000:1.0:1788509491.707209:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788509491 00002000:00010000:1.0:1788509491.707212:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788509490 00002000:00010000:1.0:1788509491.707214:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788509491.707220:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 9 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.707233:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 9 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.707253:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de30a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755327f expref: 9 pid: 8437 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.707270:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509491.707274:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509491.707279:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.707289:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.707324:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509491.707384:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2409:x1875387774742144:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 244us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509491.707401:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00010000:00010000:3.0:1788509491.707492:0:8756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.707502:0:8756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.707523:0:8756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.707530:0:8756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.707537:0:8756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.707544:0:8756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509491.707549:0:8756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.707559:0:8756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.707580:0:8756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.707586:0:8756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254d4517/0xe5156b86310de357 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509491.707630:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2409:x1875387774741888:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 14364us (14883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509491.707637:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788509491.710603:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.710679:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774742400 00000100:00100000:3.0:1788509491.710687:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774742400 00000100:00100000:3.0:1788509491.710741:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1788509491.710751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12230:x1875387774742400:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:3.0:1788509491.710811:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de349 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755329b expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788509491.711018:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788509491.711049:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788509491.711332:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1788509491.711368:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.711382:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.711390:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.711435:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.711450:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 31 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509491.711463:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875387796825216:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509491.711555:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788509491.717667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509491.717789:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875387796825216:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509491.717821:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509491.718983:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774742528 00000100:00100000:1.0:1788509491.718993:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774742528 00010000:00010000:0.0:1788509491.719110:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 32 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509491.719151:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1788509491.719160:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:2407:x1875387774742528:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509491.719283:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509491.719304:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 32 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.719316:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 32 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.719337:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de2f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553271 expref: 32 pid: 6520 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.719352:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc8761ed00) 00010000:00010000:0.0:1788509491.719357:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.719365:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.719372:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509491.719410:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509491.719470:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+31:2407:x1875387774742528:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 309us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509491.719486:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00010000:00010000:3.0:1788509491.719973:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.719983:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788509491.720100:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788509491.720292:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788509491.720381:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796825344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788509491.720433:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509491.720462:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509491.720858:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796825344 00000100:00100000:0.0:1788509491.720865:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796825344 00000100:00100000:0.0:1788509491.720994:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788509491.721003:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796825344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788509491.721087:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796825344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509491.721108:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788509491.721392:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796825344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788509491.721523:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788509491.721574:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796825472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788509491.721613:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509491.721642:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788509491.721824:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796825472 00000100:00100000:0.0:1788509491.721829:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796825472 00000100:00100000:0.0:1788509491.721928:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788509491.721937:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796825472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788509491.722040:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1875387796825472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 104us (426us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788509491.722047:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788509491.722113:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f6f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796825472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788509491.722149:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788509491.722198:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.722208:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.722215:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.722221:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509491.722225:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.722232:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.722245:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc8761ed00) 00010000:00010000:3.0:1788509491.722248:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788509491.722253:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509491.722259:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de35e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788509491.722348:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788509491.722407:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788509491.722419:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388883519683ns, next at 389883517589ns, rc = 0 00000001:00080000:3.0:1788509491.722433:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788509491.722456:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc8761ed00) 00010000:00010000:3.0:1788509491.722459:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788509491.722466:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de349 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755329b expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509491.722566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:12230:x1875387774742400:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 11817us (11973us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788509491.722575:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000020:00080000:3.0:1788509491.722579:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1788509491.722942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509491.726892:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509491.727390:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774742656 00000100:00100000:2.0:1788509491.727400:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774742656 00000100:00100000:2.0:1788509491.727463:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:2.0:1788509491.727483:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:12230:x1875387774742656:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509491.727510:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509491.727535:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de365 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532a2 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.727593:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de365 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532a2 expref: 35 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.727627:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de365 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532a2 expref: 35 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.727647:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:2.0:1788509491.727650:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509491.727655:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2e00, rc 0) 00000100:00100000:2.0:1788509491.727722:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12230:x1875387774742656:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 250us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509491.727730:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:2.0:1788509491.738884:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.739021:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774742912 00000100:00100000:1.0:1788509491.739031:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774742912 00000100:00100000:1.0:1788509491.739088:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788509491.739097:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12230:x1875387774742912:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509491.739340:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:12230:x1875387774742912:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 243us (465us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788509491.739348:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788509491.855442:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.855547:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774743168 00000100:00100000:1.0:1788509491.855556:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774743168 00000100:00100000:1.0:1788509491.855622:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:1.0:1788509491.855633:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:12240:x1875387774743168:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509491.855656:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509491.855676:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de36c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509491.855767:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788509491.856054:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de36c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532a9 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.856068:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:1.0:1788509491.856071:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788509491.856076:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de36c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532a9 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.856089:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af400, rc 0) 00000100:00100000:1.0:1788509491.856264:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12240:x1875387774743168:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 632us (830us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1788509491.856271:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:0.0:1788509491.872729:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509491.872922:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774743296 00000100:00100000:2.0:1788509491.872934:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774743296 00000100:00100000:2.0:1788509491.873062:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:2.0:1788509491.873075:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12240:x1875387774743296:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788509491.873164:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873183:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873198:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873210:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873216:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873241:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873322:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873331:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873338:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788509491.873400:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873414:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873419:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873425:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873431:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509491.873435:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873442:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873454:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:2.0:1788509491.873463:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509491.873469:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873486:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de37a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873499:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873504:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873509:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873514:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509491.873517:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873523:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873529:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761e400) 00010000:00010000:2.0:1788509491.873532:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509491.873535:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873540:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de381 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873549:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873560:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873566:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873572:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509491.873575:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873581:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873588:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:2.0:1788509491.873590:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509491.873594:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509491.873598:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de388 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509491.873680:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12240:x1875387774743296:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 607us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509491.873687:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:0.0:1788509491.876039:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.880972:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774743552 00000100:00100000:1.0:1788509491.880988:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774743552 00000100:00100000:1.0:1788509491.881065:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788509491.881076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12240:x1875387774743552:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509491.881310:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12240:x1875387774743552:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 235us (5278us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788509491.881319:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1788509491.926149:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796825600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509491.926224:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509491.926889:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796825600 00000100:00100000:3.0:1788509491.926915:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796825600 00000100:00100000:3.0:1788509491.926965:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788509491.926974:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796825600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509491.927009:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509491.927272:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796825600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 299us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509491.927280:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788509491.928171:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796825600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509491.952261:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.952408:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774743808 00000100:00100000:1.0:1788509491.952418:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774743808 00000100:00100000:1.0:1788509491.952491:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1788509491.952501:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12243:x1875387774743808:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509491.952524:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509491.952544:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de38f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952617:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952632:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952644:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952668:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952676:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952682:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952779:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952788:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952796:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509491.952805:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788509491.952939:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952947:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952954:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952960:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862aea00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509491.952964:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952983:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.952996:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509491.952999:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509491.953004:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953010:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de396 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953022:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953027:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953033:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953038:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509491.953041:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953047:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953054:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761e400) 00010000:00010000:1.0:1788509491.953058:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509491.953060:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953076:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de39d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de38f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953128:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.953136:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509491.953138:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509491.953140:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af200, rc 0) 00000100:00100000:1.0:1788509491.953199:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+40:12243:x1875387774743808:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 699us (947us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788509491.953206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1788509491.961316:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.961408:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774743936 00000100:00100000:1.0:1788509491.961417:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774743936 00000100:00100000:1.0:1788509491.961490:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:1.0:1788509491.961500:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+40:12243:x1875387774743936:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788509491.961567:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961583:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961596:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961650:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961658:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961664:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961671:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afe00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509491.961675:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961681:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961693:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509491.961696:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788509491.961700:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509491.961705:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509491.961783:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+40:12243:x1875387774743936:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 284us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509491.961790:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:3.0:1788509491.964511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509491.964589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774744192 00000100:00100000:1.0:1788509491.964599:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774744192 00000100:00100000:1.0:1788509491.964651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788509491.964673:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+40:12243:x1875387774744192:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509491.964951:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+41:12243:x1875387774744192:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 277us (449us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788509491.964959:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00010000:00010000:3.0:1788509492.118217:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509492.247126:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509492.247232:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774744448 00000100:00100000:1.0:1788509492.247242:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774744448 00000100:00100000:1.0:1788509492.247309:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:1.0:1788509492.247319:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+41:12274:x1875387774744448:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:1.0:1788509492.247343:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509492.247363:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532b7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.247486:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de3c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.247501:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.247512:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509492.247523:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788509492.247630:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b7 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.247650:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b7 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.247676:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509492.247679:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509492.247683:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af400, rc 0) 00000100:00100000:1.0:1788509492.247747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12274:x1875387774744448:12345-192.168.203.12@tcp:101:cat.0 Request processed in 430us (629us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788509492.247755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:2.0:1788509492.254557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509492.254594:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509492.254836:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774744704 00000100:00100000:1.0:1788509492.254845:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774744704 00000100:00100000:1.0:1788509492.254942:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788509492.254961:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12274:x1875387774744704:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:1.0:1788509492.255230:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12274:x1875387774744704:12345-192.168.203.12@tcp:35:cat.0 Request processed in 271us (679us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788509492.255238:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1788509492.255599:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774744832 00000100:00100000:0.0:1788509492.255605:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774744832 00000100:00100000:0.0:1788509492.255652:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788509492.255659:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:2407:x1875387774744832:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509492.255669:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509492.255690:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de3c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b7 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.255706:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509492.255711:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509492.255747:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:2407:x1875387774744832:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 88us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509492.255754:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1788509492.334596:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509492.334723:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774745088 00000100:00100000:1.0:1788509492.334732:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774745088 00000100:00100000:1.0:1788509492.334794:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:1.0:1788509492.334805:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12280:x1875387774745088:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1788509492.334829:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509492.334832:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788509492.334859:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de326 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755328d expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.334878:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509492.334884:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509492.334946:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532be expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.335061:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.335076:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.335086:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.335118:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.335133:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 43 pid: 6522 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509492.335147:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796825728:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509492.335256:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87c1e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788509492.343239:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796825728:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509492.343239:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788509492.343274:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509492.343337:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774745216 00000100:00100000:0.0:1788509492.343345:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774745216 00010000:00010000:0.0:1788509492.343391:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 44 pid: 6522 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509492.343425:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1788509492.343435:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:2407:x1875387774745216:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509492.343449:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509492.343456:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 44 pid: 6522 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.343477:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 44 pid: 6522 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.343500:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de3a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532b0 expref: 44 pid: 6522 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.343516:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509492.343521:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.343531:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.343538:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.343565:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509492.343598:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509492.343617:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:2407:x1875387774745216:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 183us (381us total) trans 0 rc 0/0 00010000:00010000:3.0:1788509492.343626:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509492.343637:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000004:00200000:3.0:1788509492.343658:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788509492.344184:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de3ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.344199:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.344206:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:3.0:1788509492.344209:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788509492.344212:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862aea00, rc 0) 00000100:00100000:3.0:1788509492.344253:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12280:x1875387774745088:12345-192.168.203.12@tcp:101:dd.0 Request processed in 9450us (9665us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788509492.344264:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:1.0:1788509492.347208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509492.347280:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774745344 00000100:00100000:3.0:1788509492.347289:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774745344 00000100:00100000:3.0:1788509492.347350:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1788509492.347359:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12280:x1875387774745344:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1788509492.347494:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509492.347515:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de3e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532c5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.347549:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.347583:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.347594:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.347832:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de3e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.347852:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.347861:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:3.0:1788509492.347863:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788509492.347867:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031a00, rc 0) 00000100:00100000:3.0:1788509492.347945:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12280:x1875387774745344:12345-192.168.203.12@tcp:101:dd.0 Request processed in 587us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509492.347953:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:1.0:1788509492.357238:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509492.357638:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774745600 00000100:00100000:3.0:1788509492.357649:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774745600 00000100:00100000:3.0:1788509492.358077:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:3.0:1788509492.358089:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12280:x1875387774745600:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1788509492.358314:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.358332:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.358356:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788509492.358400:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1788509492.358423:0:9006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b18950a8 reply state 00000000c043030d transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.358437:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.358445:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:3.0:1788509492.358447:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788509492.358451:0:9006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788509492.358760:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+47:12280:x1875387774745600:12345-192.168.203.12@tcp:36:dd.0 Request processed in 673us (1529us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788509492.358768:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000020:00080000:3.0:1788509492.358773:0:9006:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1788509492.362926:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:0.0:1788509492.362963:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788509492.362980:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bcc865a4a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788509492.362985:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcdbbf15d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bcc865a4780 00000020:00080000:0.0:1788509492.362988:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcdbbf15c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bcdbd3c1000 00000100:00100000:0.0:1788509492.363120:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796825856:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788509492.363184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509492.363255:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509492.363255:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796825856 00000100:00100000:0.0:1788509492.363263:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796825856 00010000:00010000:2.0:1788509492.363271:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363281:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363289:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509492.363294:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363303:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363318:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8bcc8761e100) 00010000:00010000:2.0:1788509492.363321:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509492.363326:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509492.363326:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1788509492.363336:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073600/0xe5156b86310de2a8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509492.363340:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796825856:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788509492.363362:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363369:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788509492.363369:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00010000:00010000:2.0:1788509492.363380:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788509492.363402:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9a7d32, atime: 0x6a9a7d33, ctime: 0x6a9a7d32, blocks: 0x8 00010000:00010000:2.0:1788509492.363404:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2072200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509492.363410:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.363412:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363421:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363431:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:2.0:1788509492.363436:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509492.363440:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.363441:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1788509492.363451:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509492.363452:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2072200/0xe5156b86310de2af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.363461:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363479:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363486:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.363488:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363499:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363504:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509492.363510:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.363522:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363523:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.363537:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.363553:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788509492.363567:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761e400) 00010000:00010000:2.0:1788509492.363569:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509492.363573:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509492.363579:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de2ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788509492.363632:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788509492.363667:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788509492.363689:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1875387796825856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 351us (504us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788509492.363696:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1788509492.370075:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509492.370089:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.370102:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ac00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509492.370107:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.370119:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.370142:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.370149:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3dc0f09/0xe5156b86310de3f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.370191:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509492.370193:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509492.370195:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788509492.370254:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcc87dfd880/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788509492.370262:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796825856:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788509492.438303:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796825984:0@lo:400:kworker.0 00000100:00100000:2.0:1788509492.438358:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796826112:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.438380:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509492.438404:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509492.438502:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796826240:0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.438544:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509492.438583:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796826112 00000100:00100000:3.0:1788509492.438590:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796826112 00000100:00100000:3.0:1788509492.438637:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788509492.438645:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796826112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.438705:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796826112:12345-0@lo:400:kworker.0 Request processed in 59us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509492.438713:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788509492.438760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796826368:0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.438784:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509492.438833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796825984 00000100:00100000:3.0:1788509492.438837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796825984 00000100:00100000:3.0:1788509492.438863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788509492.438869:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796825984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.438917:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796825984:12345-0@lo:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509492.438923:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788509492.439282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796826368 00000100:00100000:1.0:1788509492.439286:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796826368 00000100:00100000:1.0:1788509492.439322:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788509492.439329:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796826368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509492.439376:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796826368:12345-0@lo:400:kworker.0 Request processed in 48us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.439383:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788509492.440729:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796825984:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.440741:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796826496:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.440788:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509492.440819:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8844b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796827008:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.440842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509492.440881:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796827520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509492.440931:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509492.440952:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509492.440960:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796827648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509492.440984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509492.441317:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8844b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796826752:0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.441349:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509492.441370:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8844bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796827264:0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.441390:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509492.441434:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796826752 00000100:00100000:3.0:1788509492.441440:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796826752 00000100:00080000:3.0:1788509492.441463:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509492.441704:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796826240 00000100:00100000:1.0:1788509492.441709:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796826240 00000100:00100000:1.0:1788509492.441749:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796827648 00000100:00100000:1.0:1788509492.441753:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796827648 00000100:00100000:1.0:1788509492.441768:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788509492.441776:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796826240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509492.441864:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796826240:12345-0@lo:400:kworker.0 Request processed in 88us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.441872:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788509492.441924:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788509492.441932:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796827648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788509492.441956:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788509492.441991:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796827648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.441997:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788509492.442041:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796826368:0@lo:400:kworker.0 00000100:00100000:1.0:1788509492.442049:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796826880:0@lo:400:kworker.0 00000100:00100000:1.0:1788509492.442073:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509492.442094:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796827392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509492.442117:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509492.442161:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796827520 00000100:00100000:1.0:1788509492.442165:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796827520 00000100:00100000:1.0:1788509492.442190:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796827392 00000100:00100000:1.0:1788509492.442193:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796827392 00000100:00100000:1.0:1788509492.442206:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788509492.442438:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796827520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509492.442451:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509492.442499:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796827520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.442505:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788509492.442519:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788509492.442525:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875387796827392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509492.442534:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509492.442560:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875387796827392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.442565:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788509492.442748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796827392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509492.442768:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796826496 00000100:00100000:1.0:1788509492.442772:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796826496 00000100:00100000:1.0:1788509492.442796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796827008 00000100:00100000:1.0:1788509492.442799:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796827008 00000100:00100000:1.0:1788509492.442952:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788509492.442959:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796826496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509492.442991:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796826496:12345-0@lo:400:kworker.0 Request processed in 33us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.442997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788509492.443071:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788509492.443079:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796827008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509492.443109:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796827008:12345-0@lo:400:kworker.0 Request processed in 32us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.443115:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788509492.443158:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796827264 00000100:00100000:1.0:1788509492.443162:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796827264 00000100:00100000:0.0:1788509492.443251:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796827648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509492.443277:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796827520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509492.443288:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796826496:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.443298:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8844b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796827008:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.443381:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796826240:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.443399:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796826880 00000100:00100000:0.0:1788509492.443403:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796826880 00000100:00080000:3.0:1788509492.443506:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509492.443510:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509492.443512:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509492.443521:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788509492.443530:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796826752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.443572:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796826752:12345-0@lo:400:kworker.0 Request processed in 45us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509492.443578:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788509492.443887:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788509492.443895:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796827264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509492.444039:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796827264:12345-0@lo:400:kworker.0 Request processed in 145us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.444045:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788509492.444087:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8844b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796826752:0@lo:400:kworker.0 00000100:00100000:1.0:1788509492.444097:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8844bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796827264:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.444406:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788509492.444425:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796826880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.444463:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796826880:12345-0@lo:400:kworker.0 Request processed in 50us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509492.444583:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796826880:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.444737:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788509492.446021:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796826112:0@lo:400:kworker.0 00000100:00100000:2.0:1788509492.446033:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796826624:0@lo:400:kworker.0 00000100:00100000:2.0:1788509492.446083:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509492.448048:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8844ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796827136:0@lo:400:kworker.0 00000100:00100000:2.0:1788509492.448107:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509492.463520:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796826624 00000100:00100000:1.0:1788509492.463536:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796826624 00000100:00100000:1.0:1788509492.463670:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796827136 00000100:00100000:1.0:1788509492.463674:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796827136 00000100:00080000:2.0:1788509492.464926:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509492.467137:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788509492.467159:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796826624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.467332:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796826624:12345-0@lo:400:kworker.0 Request processed in 182us (21247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509492.467356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788509492.467391:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788509492.467398:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796827136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509492.467432:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796827136:12345-0@lo:400:kworker.0 Request processed in 35us (19325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509492.467438:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00080000:2.0:1788509492.470944:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87dff100 x1875387796826624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509492.470963:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796826624:0@lo:400:kworker.0 00010000:00080000:2.0:1788509492.470978:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc8844ad80 x1875387796827136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509492.470986:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8844ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796827136:0@lo:400:kworker.0 00000100:00100000:0.0:1788509492.718341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509492.718620:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774745728 00000100:00100000:1.0:1788509492.718629:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774745728 00000100:00100000:1.0:1788509492.718693:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:1.0:1788509492.718704:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8844b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:12294:x1875387774745728:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:1.0:1788509492.718726:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509492.718747:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de3ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532cc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718816:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718830:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718842:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718858:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718879:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718886:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718976:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718987:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.718996:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.719028:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.719041:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 21 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509492.719054:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796827776:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509492.719287:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87c1e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788509492.722709:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509492.722862:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774745984 00000100:00100000:0.0:1788509492.722872:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774745984 00000100:00100000:0.0:1788509492.722948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788509492.722958:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:6178:x1875387774745984:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788509492.723253:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:6178:x1875387774745984:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 296us (553us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788509492.723261:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1788509492.724240:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796827776:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509492.724268:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509492.726356:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509492.726455:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774746112 00000100:00100000:0.0:1788509492.726464:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774746112 00010000:00010000:0.0:1788509492.726747:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 23 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509492.726787:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1788509492.726796:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:2408:x1875387774746112:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509492.726810:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509492.726816:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 23 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.726839:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 23 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.726862:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de3d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532be expref: 23 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.726878:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509492.726884:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.726893:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.726997:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.727033:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509492.727088:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:2408:x1875387774746112:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 292us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509492.727095:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00010000:00010000:1.0:1788509492.727608:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727626:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509492.727679:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788509492.727683:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509492.727704:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727718:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727728:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727734:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727740:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727745:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862aec00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509492.727749:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727756:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727767:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509492.727770:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509492.727773:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727789:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de406 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727812:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727820:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727826:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727830:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afc00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509492.727833:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727840:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727848:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509492.727851:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509492.727854:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727860:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de40d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727935:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de3ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532cc expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727951:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532cc expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509492.727966:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509492.727968:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509492.727971:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae000, rc 0) 00000100:00100000:1.0:1788509492.728008:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8844b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12294:x1875387774745728:12345-192.168.203.12@tcp:101:stat.0 Request processed in 9306us (9675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509492.728015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:2.0:1788509492.809776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509492.809885:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774746368 00000100:00100000:0.0:1788509492.809895:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774746368 00000100:00100000:0.0:1788509492.809979:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:0.0:1788509492.809988:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12300:x1875387774746368:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:0.0:1788509492.810043:0:9006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509492.810067:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de414 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532cc expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.810105:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509492.810109:0:9006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509492.810261:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.810275:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.810285:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788509492.810322:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788509492.810342:0:9006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fe24d16 reply state 000000000adc0cfa transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.810355:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509492.810362:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509492.810365:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509492.810368:0:9006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788509492.810464:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:12300:x1875387774746368:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 476us (698us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788509492.810481:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000020:00080000:0.0:1788509492.810486:0:9006:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788509492.950174:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788509492.950199:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796827904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509492.950286:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509492.950515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796828032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509492.950543:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509492.950618:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796827904 00000100:00100000:0.0:1788509492.950626:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796827904 00000100:00100000:0.0:1788509492.950676:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796828032 00000100:00100000:0.0:1788509492.950679:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796828032 00000100:00100000:0.0:1788509492.950696:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788509492.950719:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796827904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509492.950759:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788509492.950806:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796827904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509492.950815:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788509492.950831:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788509492.950837:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796828032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509492.950847:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788509492.950870:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796828032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509492.950877:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788509492.950935:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796828032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509492.950949:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796827904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509492.992324:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509492.992432:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774746496 00000100:00100000:3.0:1788509492.992453:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774746496 00000100:00100000:3.0:1788509492.992551:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:3.0:1788509492.992562:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:12314:x1875387774746496:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:3.0:1788509492.992593:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509492.992618:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de422 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.992703:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.992721:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.992736:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.992774:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.992786:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.992793:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993113:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993126:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993133:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509492.993183:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788509492.993188:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788509492.993216:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993230:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993239:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993246:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993265:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993272:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509492.993277:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993285:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993299:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:3.0:1788509492.993303:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509492.993308:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993315:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de429 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993332:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993337:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993343:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993348:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509492.993351:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993366:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993374:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcd8a893f00) 00010000:00010000:3.0:1788509492.993376:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509492.993379:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993385:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de430 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993420:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de422 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993436:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509492.993518:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:3.0:1788509492.993521:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788509492.993524:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8e00, rc 0) 00000100:00100000:3.0:1788509492.993609:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:12314:x1875387774746496:12345-192.168.203.12@tcp:101:stat.0 Request processed in 1048us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509492.993618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:2.0:1788509493.084701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.084819:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774746752 00000100:00100000:0.0:1788509493.084832:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774746752 00000100:00100000:0.0:1788509493.084962:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:0.0:1788509493.084977:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:12325:x1875387774746752:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509493.085003:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509493.085030:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de43e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532da expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509493.085159:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788509493.085283:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de43e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532da expref: 26 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.085324:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:0.0:1788509493.085328:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509493.085335:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de43e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532da expref: 26 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.085354:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a000, rc 0) 00000100:00080000:2.0:1788509493.085545:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509493.085586:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12325:x1875387774746752:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 612us (899us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788509493.085594:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:2.0:1788509493.090503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.090679:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774747008 00000100:00100000:0.0:1788509493.090692:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774747008 00000100:00100000:0.0:1788509493.090769:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788509493.090782:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12325:x1875387774747008:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788509493.091673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+26:12325:x1875387774747008:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 890us (1264us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788509493.091683:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1788509493.140330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.140440:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774747264 00000100:00100000:0.0:1788509493.140453:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774747264 00000100:00100000:0.0:1788509493.140543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:0.0:1788509493.140556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+26:12331:x1875387774747264:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509493.140588:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509493.140616:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de44c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.140760:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.140795:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.140818:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.140860:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.140876:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 27 pid: 6521 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509493.140931:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796828160:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509493.141049:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788509493.142301:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509493.144716:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.144716:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796828160:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509493.144760:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509493.144843:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774747392 00000100:00100000:3.0:1788509493.144851:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774747392 00010000:00010000:3.0:1788509493.144922:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 28 pid: 6521 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509493.144983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:3.0:1788509493.144994:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+28:2408:x1875387774747392:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509493.145022:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509493.145030:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 28 pid: 6521 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.145044:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 28 pid: 6521 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.145082:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de437 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532d3 expref: 28 pid: 6521 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.145103:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:3.0:1788509493.145109:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.145121:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.145130:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.145574:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.145584:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.145591:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1788509493.145608:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:3.0:1788509493.145669:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:2408:x1875387774747392:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 676us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509493.145677:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00010000:00010000:1.0:1788509493.145790:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de44c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.145822:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.145831:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509493.145834:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788509493.145837:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a400, rc 0) 00000100:00100000:1.0:1788509493.145870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12331:x1875387774747264:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5317us (5555us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788509493.145878:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:2.0:1788509493.150544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509493.150721:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774747648 00000100:00100000:1.0:1788509493.150753:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774747648 00000100:00100000:1.0:1788509493.150957:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:1.0:1788509493.150971:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12331:x1875387774747648:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:1.0:1788509493.151273:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.151296:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.151310:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788509493.151361:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1788509493.151593:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059cd1f39 reply state 00000000701a16cd transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.151716:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.151728:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509493.151731:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509493.151736:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788509493.151878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:12331:x1875387774747648:12345-192.168.203.12@tcp:36:bash.0 Request processed in 909us (1515us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788509493.151887:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 176 00000020:00080000:1.0:1788509493.151894:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788509493.156437:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509493.156708:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774747776 00000100:00100000:3.0:1788509493.156741:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774747776 00000100:00100000:3.0:1788509493.156824:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:3.0:1788509493.156835:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:12331:x1875387774747776:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788509493.156865:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509493.156891:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de468 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.157085:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.157104:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.157115:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.157158:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.157174:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 31 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509493.157191:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f51880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796828288:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509493.157297:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6363480 going to sleep for 11 seconds 00000100:00100000:1.0:1788509493.162588:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f51880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796828288:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509493.162758:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509493.163486:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.163545:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774747904 00000100:00100000:0.0:1788509493.163556:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774747904 00010000:00010000:0.0:1788509493.163607:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 32 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509493.163657:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:0.0:1788509493.163668:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:2407:x1875387774747904:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509493.163688:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509493.163723:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 32 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.163804:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 32 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.163833:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de453 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e1 expref: 32 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.163865:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509493.163872:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.163885:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.163895:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.163970:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509493.164153:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+31:2407:x1875387774747904:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 485us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509493.164162:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00010000:00010000:1.0:1788509493.164358:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.164376:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509493.164450:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788509493.164455:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509493.164494:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.164533:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de468 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e8 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.164555:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e8 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.164564:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509493.164567:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509493.164570:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9200, rc 0) 00000100:00100000:1.0:1788509493.164611:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:12331:x1875387774747776:12345-192.168.203.12@tcp:101:bash.0 Request processed in 7778us (8188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509493.164620:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:3.0:1788509493.171309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.172192:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774748160 00000100:00100000:0.0:1788509493.172209:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774748160 00000100:00100000:0.0:1788509493.172294:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788509493.172309:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:12331:x1875387774748160:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788509493.172944:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+31:12331:x1875387774748160:12345-192.168.203.12@tcp:35:bash.0 Request processed in 636us (1647us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788509493.172975:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788509493.255284:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.255401:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774748416 00000100:00100000:0.0:1788509493.255414:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774748416 00000100:00100000:0.0:1788509493.255556:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:0.0:1788509493.255569:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+31:12341:x1875387774748416:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509493.255603:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509493.255633:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532ef expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509493.255765:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788509493.255965:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de476 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532ef expref: 33 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.255984:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:0.0:1788509493.255988:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509493.255994:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532ef expref: 33 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.256013:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a400, rc 0) 00000100:00100000:0.0:1788509493.256091:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:12341:x1875387774748416:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 526us (820us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788509493.256099:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:3.0:1788509493.259687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509493.259793:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774748544 00000100:00100000:1.0:1788509493.259815:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774748544 00000100:00100000:3.0:1788509493.260022:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:3.0:1788509493.260034:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:12341:x1875387774748544:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1788509493.260165:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260187:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260203:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260222:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260230:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260237:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260329:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260339:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260346:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788509493.260408:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260424:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260442:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260449:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260456:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509493.260461:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260486:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260502:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:3.0:1788509493.260504:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509493.260510:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260516:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de484 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260533:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260539:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260545:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260550:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509493.260561:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260567:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260574:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcd8a893f00) 00010000:00010000:3.0:1788509493.260577:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509493.260579:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260585:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de48b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260601:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260607:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260613:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260619:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509493.260622:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260628:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260636:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:3.0:1788509493.260638:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509493.260647:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509493.260653:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de492 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509493.260752:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:12341:x1875387774748544:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 720us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509493.260762:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:3.0:1788509493.263772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.263887:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774748800 00000100:00100000:0.0:1788509493.263942:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774748800 00000100:00100000:0.0:1788509493.264001:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788509493.264011:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:12341:x1875387774748800:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788509493.264297:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+33:12341:x1875387774748800:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 286us (538us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788509493.264306:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1788509493.301774:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509493.301956:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774749056 00000100:00100000:1.0:1788509493.301969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774749056 00000100:00100000:1.0:1788509493.302054:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:1.0:1788509493.302067:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+33:12344:x1875387774749056:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509493.302101:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509493.302130:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de499 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532f6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302243:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302261:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302275:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302291:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302298:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302306:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302439:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de4ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302451:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de4ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302458:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de4ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509493.302483:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788509493.302585:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302594:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302608:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302615:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862aec00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509493.302620:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302629:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302642:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509493.302646:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509493.302651:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302658:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aec00/0xe5156b86310de4a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302674:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302680:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302686:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302691:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509493.302695:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302710:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302718:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509493.302721:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509493.302723:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302729:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302777:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de499 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532f6 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302792:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de4ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532f6 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.302815:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509493.302818:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509493.302820:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862afe00, rc 0) 00000100:00100000:1.0:1788509493.302971:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12344:x1875387774749056:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 906us (1210us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788509493.302980:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:3.0:1788509493.306613:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509493.306720:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774749184 00000100:00100000:1.0:1788509493.306733:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774749184 00000100:00100000:1.0:1788509493.306817:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:1.0:1788509493.306830:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12344:x1875387774749184:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788509493.307245:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307268:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307283:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307329:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307337:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307344:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307351:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afc00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509493.307356:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307365:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307379:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509493.307382:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788509493.307390:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.307396:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509493.307517:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12344:x1875387774749184:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 689us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509493.307526:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:3.0:1788509493.310146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.310237:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774749312 00000100:00100000:0.0:1788509493.310250:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774749312 00000100:00100000:0.0:1788509493.310331:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788509493.310344:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:2410:x1875387774749312:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509493.310363:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509493.310403:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de4ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532f6 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.310427:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509493.310433:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509493.310516:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:2410:x1875387774749312:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 174us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509493.310524:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788509493.313421:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.313518:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774749568 00000100:00100000:0.0:1788509493.313532:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774749568 00000100:00100000:0.0:1788509493.313603:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788509493.313638:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:12344:x1875387774749568:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788509493.314234:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12344:x1875387774749568:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 618us (823us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788509493.314243:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1788509493.459996:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509493.460152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774749824 00000100:00100000:1.0:1788509493.460165:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774749824 00000100:00100000:1.0:1788509493.460245:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:1.0:1788509493.460258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12362:x1875387774749824:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:1.0:1788509493.460293:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509493.460322:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475532fd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.460489:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.460509:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.460524:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509493.460539:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788509493.460679:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532fd expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.460703:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532fd expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.460713:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509493.460734:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788509493.460739:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af200, rc 0) 00000100:00100000:1.0:1788509493.460818:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12362:x1875387774749824:12345-192.168.203.12@tcp:101:cat.0 Request processed in 562us (839us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788509493.460826:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788509493.481453:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.481803:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774749952 00000100:00100000:0.0:1788509493.481818:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774749952 00000100:00100000:0.0:1788509493.482245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:0.0:1788509493.482259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12363:x1875387774749952:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509493.482292:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509493.482333:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de4d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553304 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.482432:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de4df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.482450:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de4df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.482479:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de4df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509493.482539:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788509493.482544:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509493.482569:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de4df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.482602:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de4d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553304 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.482625:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de4df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553304 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.482634:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509493.482638:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509493.482641:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590bc00, rc 0) 00000100:00100000:0.0:1788509493.482731:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12363:x1875387774749952:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 474us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509493.482751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:2.0:1788509493.491113:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509493.491551:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774750336 00000100:00100000:1.0:1788509493.491566:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774750336 00000100:00100000:1.0:1788509493.491732:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1788509493.491746:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12363:x1875387774750336:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509493.492484:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:12363:x1875387774750336:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 736us (1679us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788509493.492495:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788509493.495513:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.495722:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774750464 00000100:00100000:0.0:1788509493.495736:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774750464 00000100:00100000:1.0:1788509493.496051:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788509493.496069:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:12363:x1875387774750464:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:1.0:1788509493.496090:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788509493.496121:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de46f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532e8 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.496152:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de4ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532fd expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.496165:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2e00/0xe5156b86310de365 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532a2 expref: 37 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.496177:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509493.496183:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509493.496866:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:12363:x1875387774750464:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 800us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509493.496876:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788509493.499764:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509493.499998:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774750592 00000100:00100000:1.0:1788509493.500011:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774750592 00000100:00100000:1.0:1788509493.500078:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:1.0:1788509493.500090:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:12363:x1875387774750592:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:1.0:1788509493.500239:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.500261:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509493.500275:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788509493.500430:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788509493.500549:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:12363:x1875387774750592:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 460us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509493.500558:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:2.0:1788509493.523887:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509493.524101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509493.524142:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509493.524237:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774751104 00000100:00100000:3.0:1788509493.524250:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774751104 00000100:00100000:3.0:1788509493.524328:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:3.0:1788509493.524341:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774751104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509493.524443:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774751104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 104us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509493.524451:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00080000:3.0:1788509493.524489:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788509493.525581:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509493.525634:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509493.525676:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509493.525801:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774750720 00000100:00100000:3.0:1788509493.525811:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774750720 00000100:00100000:3.0:1788509493.525859:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 387 00000100:00100000:3.0:1788509493.525868:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2407:x1875387774750720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509493.525961:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd892a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2407:x1875387774750720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509493.525986:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 387 00000100:00100000:3.0:1788509493.526159:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774750976 00000100:00100000:3.0:1788509493.526164:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774750976 00000100:00100000:3.0:1788509493.526212:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:3.0:1788509493.526219:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774750976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509493.526252:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774750976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509493.526259:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00080000:3.0:1788509493.526274:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509493.532915:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774750848 00000100:00100000:0.0:1788509493.532938:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774750848 00000100:00100000:0.0:1788509493.533033:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774751360 00000100:00100000:0.0:1788509493.533037:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774751360 00000100:00100000:0.0:1788509493.533056:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774751232 00000100:00100000:0.0:1788509493.533060:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774751232 00000100:00100000:0.0:1788509493.533088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 323 00000100:00100000:0.0:1788509493.533100:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774750848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509493.533210:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2407:x1875387774750848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 111us (9336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509493.533218:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 323 00000100:00100000:0.0:1788509493.533242:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 324 00000100:00100000:0.0:1788509493.533249:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774751360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509493.533277:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774751360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (9135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509493.533283:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 324 00000100:00100000:0.0:1788509493.533294:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 325 00000100:00100000:0.0:1788509493.533300:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774751232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509493.533325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2407:x1875387774751232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (7648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509493.533331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 325 00000100:00080000:2.0:1788509493.534864:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509493.534878:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509493.544066:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509493.544223:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774751488 00000100:00100000:0.0:1788509493.544249:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774751488 00000100:00100000:0.0:1788509493.544334:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:0.0:1788509493.544345:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+36:12365:x1875387774751488:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509493.544384:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509493.544414:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de4ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755330b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.544520:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.544541:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.544556:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.544574:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.544581:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.544588:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545145:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545160:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545168:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509493.545235:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788509493.545240:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509493.545265:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545280:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545290:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545298:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545314:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545320:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509493.545325:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545334:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545348:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509493.545351:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509493.545357:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545365:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de4f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545733:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545740:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545747:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545753:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509493.545756:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545763:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545773:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc865bc400) 00010000:00010000:0.0:1788509493.545776:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509493.545779:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.545786:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de4fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.546100:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de4ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.546117:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509493.546137:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509493.546139:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509493.546142:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a800, rc 0) 00000100:00100000:0.0:1788509493.546233:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12365:x1875387774751488:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1888us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509493.546243:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00010000:00010000:2.0:1788509494.168307:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788509494.379294:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509494.379306:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509494.379351:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788509494.379364:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788509494.379577:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796828416:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788509494.380189:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd837489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509494.387529:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796828416:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788509494.393119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.393502:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774751616 00000100:00100000:1.0:1788509494.393515:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774751616 00000100:00100000:1.0:1788509494.393593:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:1.0:1788509494.393606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12376:x1875387774751616:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788509494.393647:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788509494.393811:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12376:x1875387774751616:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 206us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.393819:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:0.0:1788509494.409141:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509494.409195:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774751744 00000100:00100000:0.0:1788509494.409208:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774751744 00000100:00100000:0.0:1788509494.409476:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:0.0:1788509494.409495:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12376:x1875387774751744:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788509494.409598:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.409619:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.409633:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.412038:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.412063:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.412075:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.412113:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.412122:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.412129:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509494.412184:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788509494.413421:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509494.413447:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413477:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413484:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413491:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413516:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ae00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.413521:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413529:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413543:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:0.0:1788509494.413546:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509494.413551:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413557:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ae00/0xe5156b86310de509 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413574:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413580:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413586:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413591:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.413593:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413600:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413618:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8bcc865bc200) 00010000:00010000:0.0:1788509494.413621:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509494.413625:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413630:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310de510 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413661:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413667:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413672:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413676:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.413678:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413684:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413691:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509494.413693:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509494.413696:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.413701:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a400/0xe5156b86310de517 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509494.413818:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12376:x1875387774751744:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 4325us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509494.413829:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:3.0:1788509494.419791:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509494.419915:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774752000 00000100:00100000:0.0:1788509494.419931:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774752000 00000100:00100000:0.0:1788509494.420005:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:0.0:1788509494.420015:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12376:x1875387774752000:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788509494.420036:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509494.420057:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de51e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553312 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420203:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420218:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420230:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509494.420241:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788509494.420329:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420337:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420343:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420360:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846fa00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.420364:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420372:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420385:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509494.420388:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509494.420394:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420401:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de525 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420443:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de51e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553312 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420453:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:0.0:1788509494.420467:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509494.420472:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a000/0xe5156b86310de51e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553312 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.420484:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a000, rc 0) 00000100:00100000:0.0:1788509494.420563:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12376:x1875387774752000:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 548us (796us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788509494.420571:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:0.0:1788509494.431476:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509494.431989:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774752128 00000100:00100000:2.0:1788509494.432007:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774752128 00000100:00100000:3.0:1788509494.432479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:3.0:1788509494.432497:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12376:x1875387774752128:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788509494.432551:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788509494.432728:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12376:x1875387774752128:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 237us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509494.432737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1788509494.441614:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509494.444299:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774752384 00000100:00100000:0.0:1788509494.444319:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774752384 00000100:00100000:0.0:1788509494.444426:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:0.0:1788509494.444441:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12376:x1875387774752384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788509494.444479:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509494.444483:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788509494.444521:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590bc00/0xe5156b86310de4df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553304 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.444547:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509494.444554:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509494.444572:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de533 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553319 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788509494.445351:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788509494.445566:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de53a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.445585:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de53a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.445599:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de53a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.445668:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de533 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553319 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.445687:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de53a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553319 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.445722:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc865bc200) 00010000:00010000:0.0:1788509494.445726:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509494.445729:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846f600, rc 0) 00000100:00100000:0.0:1788509494.446536:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:12376:x1875387774752384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2090us (4929us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788509494.446548:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:2.0:1788509494.460566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509494.464725:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774752640 00000100:00100000:0.0:1788509494.464749:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774752640 00000100:00100000:0.0:1788509494.465002:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:0.0:1788509494.465015:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:12376:x1875387774752640:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788509494.465102:0:9006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509494.465142:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de53a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553319 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465162:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc865bc200) 00010000:00010000:0.0:1788509494.465178:0:9006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509494.465212:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465229:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465242:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465259:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465289:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465297:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465358:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465526:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465534:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465540:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846fa00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.465545:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465555:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465566:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509494.465569:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509494.465574:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465580:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de548 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465591:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465604:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465610:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465614:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.465616:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465621:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465627:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x239820b4 (ffff8bcc865bce00) 00010000:00010000:0.0:1788509494.465630:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509494.465632:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.465638:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de54f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x239820b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509494.465767:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12376:x1875387774752640:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 754us (5212us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788509494.465776:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:1.0:1788509494.470050:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.470096:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774752768 00000100:00100000:1.0:1788509494.470107:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774752768 00000100:00100000:1.0:1788509494.470184:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:1.0:1788509494.470197:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12376:x1875387774752768:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509494.470225:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509494.470254:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de556 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553320 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.470301:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.470319:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.470333:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.470501:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de556 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.470521:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.470531:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509494.470534:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788509494.470539:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae400, rc 0) 00000100:00100000:1.0:1788509494.470613:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:12376:x1875387774752768:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 418us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.470632:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:2.0:1788509494.475685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.475806:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774753024 00000100:00100000:1.0:1788509494.475819:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774753024 00000100:00100000:1.0:1788509494.475929:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:1.0:1788509494.475944:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:12376:x1875387774753024:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788509494.476069:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.476093:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.476109:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788509494.476337:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788509494.476349:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391637450000ns, next at 392637446510ns, rc = 0 00000004:00010000:1.0:1788509494.476420:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9a6ce53 reply state 00000000143733f8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.476435:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.476444:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509494.476447:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788509494.476452:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788509494.476596:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+41:12376:x1875387774753024:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 655us (924us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788509494.476603:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:2.0:1788509494.480525:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.487115:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774753152 00000100:00100000:1.0:1788509494.487161:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774753152 00000100:00100000:1.0:1788509494.487314:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:1.0:1788509494.487330:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+41:12376:x1875387774753152:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509494.487380:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509494.487414:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553327 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.487514:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.487533:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.487558:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509494.487562:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788509494.487566:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af400, rc 0) 00000100:00100000:1.0:1788509494.487653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+42:12376:x1875387774753152:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 327us (7142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.487661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:0.0:1788509494.495495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509494.495764:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774753280 00000100:00100000:3.0:1788509494.495787:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774753280 00000100:00100000:3.0:1788509494.495873:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1788509494.495885:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2407:x1875387774753280:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788509494.496229:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774753280:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 346us (749us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788509494.496260:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1788509494.498253:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.501879:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774753536 00000100:00100000:1.0:1788509494.501895:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774753536 00000100:00100000:1.0:1788509494.501992:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788509494.502004:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+42:12376:x1875387774753536:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788509494.502698:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12376:x1875387774753536:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 693us (4451us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788509494.502707:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788509494.506578:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509494.506671:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774753792 00000100:00100000:3.0:1788509494.506699:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774753792 00000100:00100000:3.0:1788509494.506807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:3.0:1788509494.506820:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12376:x1875387774753792:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788509494.507035:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12376:x1875387774753792:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 217us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509494.507041:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:0.0:1788509494.511121:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.511407:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774753920 00000100:00100000:1.0:1788509494.511417:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774753920 00000100:00100000:1.0:1788509494.511495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:1.0:1788509494.511507:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8844a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12376:x1875387774753920:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509494.511537:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509494.511563:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae200/0xe5156b86310de572 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755332e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.511656:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de579 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.511672:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de579 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.511685:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de579 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509494.511733:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509494.511769:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de579 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.512004:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae200/0xe5156b86310de572 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755332e expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.512023:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de579 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755332e expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.512032:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509494.512034:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788509494.512038:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af600, rc 0) 00000100:00100000:1.0:1788509494.512166:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8844a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12376:x1875387774753920:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 661us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.512175:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:3.0:1788509494.518914:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.519049:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774754048 00000100:00100000:1.0:1788509494.519074:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774754048 00000100:00100000:1.0:1788509494.519150:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1788509494.519164:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774754048:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509494.519183:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509494.519205:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553335 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788509494.519231:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a7d35, blocks: 0x0 00010000:00010000:1.0:1788509494.519250:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1788509494.519255:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509494.519265:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.519285:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.519299:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862afa00, rc 0) 00000100:00100000:1.0:1788509494.519374:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774754048:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 213us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.519381:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1788509494.527517:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509494.527579:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774754304 00000100:00100000:0.0:1788509494.527595:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774754304 00000100:00100000:0.0:1788509494.527683:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:0.0:1788509494.527726:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12376:x1875387774754304:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788509494.529709:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12376:x1875387774754304:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 1976us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509494.538115:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:2.0:1788509494.539611:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509494.540151:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774754432 00000100:00100000:3.0:1788509494.540164:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774754432 00000100:00100000:3.0:1788509494.540272:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788509494.540285:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:12376:x1875387774754432:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788509494.540308:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509494.540334:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755333c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.540384:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.540395:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509494.540400:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509494.540406:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.540476:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.540493:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 9 pid: 8438 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.540509:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796828544:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509494.540663:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5980900 going to sleep for 11 seconds 00000100:00100000:3.0:1788509494.558329:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509494.558391:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774754560 00000100:00100000:3.0:1788509494.558404:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774754560 00010000:00010000:3.0:1788509494.558468:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 10 pid: 8438 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.558520:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:3.0:1788509494.558532:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2408:x1875387774754560:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509494.558551:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509494.558580:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 10 pid: 8438 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.558596:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 10 pid: 8438 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.558628:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509494.558646:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509494.558657:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.558668:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.558716:0:7472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.558732:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7472:1875387796828672:192.168.203.12@tcp:105: 00000100:00100000:3.0:1788509494.559000:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5980cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788509494.559375:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000625a17b0/0xe5156b86310de580 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553335 expref: 10 pid: 8438 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509494.559401:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796828544:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509494.559431:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.559447:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8400, rc 0) 00000100:00100000:1.0:1788509494.559509:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:12376:x1875387774754432:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 19227us (19908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.559519:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788509494.561171:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7472:1875387796828672:192.168.203.12@tcp:105: 00010000:00010000:3.0:1788509494.561197:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509494.561248:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774754560:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 2717us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509494.561261:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000040:00080000:2.0:1788509494.562627:0:14657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788509494.562637:0:14657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788509494.562668:0:14657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788509494.562678:0:14657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788509494.563170:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.563284:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774754688 00000100:00100000:1.0:1788509494.563295:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774754688 00002000:00100000:1.0:1788509494.563360:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8bcdb78bdf80 x1875387774754688/t0(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:575/0 lens 504/0 e 0 to 0 dl 1788509505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509494.563373:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcdb78bdf80 with x1875387774754688 ext(0->8) 00002000:00010000:1.0:1788509494.563380:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcdb78bdf80 00000100:00100000:1.0:1788509494.563423:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788509494.563435:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774754688:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788509494.564635:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2407:x1875387774754688:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 1193us (1461us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788509494.564650:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00002000:00100000:1.0:1788509494.564662:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8bcdb78bdf80 x1875387774754688/t4294967315(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:575/0 lens 504/448 e 0 to 0 dl 1788509505 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509494.564673:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcdb78bdf80 with x1875387774754688 ext(0->8) 00002000:00010000:1.0:1788509494.564686:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcdb78bdf80 00000100:00100000:3.0:1788509494.568489:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509494.568753:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774754816 00000100:00100000:0.0:1788509494.568768:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774754816 00000100:00100000:0.0:1788509494.568929:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:0.0:1788509494.568943:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12376:x1875387774754816:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788509494.572626:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1788509494.572975:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788509494.573053:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1788509494.573102:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573115:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573124:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573130:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.573136:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573145:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573168:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509494.573171:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509494.573187:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573194:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de3f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573219:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573227:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573233:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573239:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590ac00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.573242:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573248:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573257:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509494.573260:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509494.573263:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573268:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590ac00/0xe5156b86310de41b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573282:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573288:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573300:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573304:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862aee00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.573308:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573315:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573323:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509494.573326:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509494.573328:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573334:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de461 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573347:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573353:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573359:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573365:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.573368:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573512:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573525:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:0.0:1788509494.573528:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788509494.573532:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.573538:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de564 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509494.573862:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:12376:x1875387774754816:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 4915us (5380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509494.573874:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:3.0:1788509494.574840:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509494.574863:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb78a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796828800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788509494.574977:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509494.575033:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796828800 00000100:00100000:3.0:1788509494.575042:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796828800 00000100:00100000:3.0:1788509494.575108:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788509494.575120:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796828800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788509494.575291:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788509494.575296:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788509493 00002000:00010000:3.0:1788509494.575298:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788509494.575301:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788509493 -> 1788509493 00002000:00010000:3.0:1788509494.575304:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788509494.575349:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796828800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (371us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788509494.575356:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1788509494.575411:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcdb78a8700/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788509494.575418:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb78a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796828800:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1788509494.575727:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788509494.575745:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:2.0:1788509494.575755:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509494.578234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.578635:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774754944 00000100:00100000:1.0:1788509494.578649:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774754944 00000100:00100000:1.0:1788509494.578721:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1788509494.578733:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2407:x1875387774754944:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788509494.583551:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788509494.583572:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1788509494.583927:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2407:x1875387774754944:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 5165us (5671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509494.583941:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788509494.592270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.593172:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774755200 00000100:00100000:1.0:1788509494.593188:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774755200 00000100:00100000:1.0:1788509494.593278:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:1.0:1788509494.593292:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:12376:x1875387774755200:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788509494.593378:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509494.593416:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de579 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755332e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.593587:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509494.593595:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509494.593637:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.593654:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.593666:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509494.594025:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf8a8c31 reply state 0000000085492341 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.594041:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.594065:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509494.594068:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509494.594071:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788509494.594214:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:12376:x1875387774755200:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 923us (1956us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788509494.594223:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:2.0:1788509494.599642:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509494.599722:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774755328 00000100:00100000:3.0:1788509494.599737:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774755328 00000100:00100000:3.0:1788509494.599821:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788509494.599833:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2410:x1875387774755328:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788509494.600077:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788509494.600081:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788509493 -> 1788509492 00002000:00010000:3.0:1788509494.600085:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788509491 00002000:00010000:3.0:1788509494.600087:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788509493 -> 1788509492 00002000:00010000:3.0:1788509494.600089:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788509494.600165:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2410:x1875387774755328:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 333us (536us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788509494.600174:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788509494.604024:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.604175:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774755584 00000100:00100000:1.0:1788509494.604189:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774755584 00000100:00100000:1.0:1788509494.604272:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:1.0:1788509494.604285:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:12376:x1875387774755584:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788509494.604389:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.604412:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.604423:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.604481:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.604498:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 20 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509494.604515:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796828928:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509494.604616:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87c1e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788509494.607342:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796828928:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509494.607381:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509494.612735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.612873:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774755712 00000100:00100000:1.0:1788509494.612887:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774755712 00010000:00010000:1.0:1788509494.612972:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 21 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509494.613023:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1788509494.613035:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:2407:x1875387774755712:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509494.613053:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509494.613062:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 21 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.613079:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 21 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.613109:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de55d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553320 expref: 21 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.613127:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509494.613133:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.613145:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.613155:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.613199:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509494.613267:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:2407:x1875387774755712:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 234us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.613275:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00010000:00010000:3.0:1788509494.614138:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.614159:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.614212:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.614221:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.614229:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.614234:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509494.614240:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.614248:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.614264:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:3.0:1788509494.614267:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788509494.614272:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.614279:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de595 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.614374:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:12376:x1875387774755584:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 10089us (10364us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788509494.614383:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:3.0:1788509494.620473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509494.620626:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774755840 00000100:00100000:0.0:1788509494.620640:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774755840 00000100:00100000:0.0:1788509494.620720:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1788509494.620732:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774755840:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788509494.620800:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.620828:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.620859:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509494.620865:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788509494.620871:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.621380:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.621402:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 8 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509494.621422:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796829056:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509494.621555:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd837489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509494.623692:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796829056:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509494.623734:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509494.624650:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509494.624854:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774755968 00000100:00100000:3.0:1788509494.624863:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774755968 00010000:00010000:3.0:1788509494.626145:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.626609:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:3.0:1788509494.626628:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2407:x1875387774755968:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509494.626648:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509494.626686:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.626705:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.626735:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de587 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755333c expref: 9 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.626752:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509494.626756:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509494.626772:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.626798:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.626838:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509494.626949:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774755968:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 329us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509494.626958:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00010000:00010000:0.0:1788509494.627577:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.627591:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.627620:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.627629:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.627650:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.627658:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509494.627663:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.627673:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.627690:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.627698:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009409c866/0xe5156b86310de59c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509494.627829:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774755840:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 7097us (7381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509494.627840:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1788509494.632616:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509494.632753:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774756224 00000100:00100000:2.0:1788509494.632839:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774756224 00000100:00100000:2.0:1788509494.633097:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1788509494.633110:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:12376:x1875387774756224:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788509494.633220:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509494.633242:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509494.633254:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509494.633300:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509494.633335:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 19 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509494.633355:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796829184:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509494.633480:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509494.637425:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.637568:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796829184:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509494.637607:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.637746:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774756352 00000100:00100000:3.0:1788509494.637754:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774756352 00010000:00010000:3.0:1788509494.637800:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 20 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.637849:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1788509494.637861:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8844aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:2408:x1875387774756352:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509494.637878:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509494.637885:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 20 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.637920:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 20 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.637948:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de3ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475532c5 expref: 20 pid: 6522 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.637967:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:3.0:1788509494.637981:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.637994:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.638003:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.638028:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509494.638277:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.638286:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.638355:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8844aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:2408:x1875387774756352:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 496us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509494.638363:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00010000:00010000:1.0:1788509494.638587:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.638601:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.638611:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.638652:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.638668:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 19 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509494.638694:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796829312:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509494.638773:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87c1e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788509494.643382:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796829312:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509494.643429:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.643745:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.643874:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774756480 00000100:00100000:1.0:1788509494.643882:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774756480 00010000:00010000:1.0:1788509494.644029:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 20 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509494.644235:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:1.0:1788509494.644247:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:2408:x1875387774756480:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509494.644266:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509494.644274:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 20 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.644288:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 20 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.644315:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de56b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553327 expref: 20 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.644329:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:1.0:1788509494.644335:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.644367:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.644376:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.644402:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509494.644689:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:2408:x1875387774756480:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 251us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.644698:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00010000:00010000:1.0:1788509494.646215:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.646230:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788509494.646387:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788509494.646562:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788509494.646603:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788509494.646707:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9006:1875387796829440:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788509494.646793:0:9006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509494.646841:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a5d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788509494.646873:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796829440 00000100:00100000:2.0:1788509494.646885:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796829440 00000100:00100000:2.0:1788509494.646966:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788509494.646977:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9006:x1875387796829440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788509494.647081:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9006:x1875387796829440:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509494.647089:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788509494.649023:0:9006:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788509494.649039:0:9006:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcdb78a8700, transno 4294967316 00000100:00100000:1.0:1788509494.649072:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9006:1875387796829440:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788509494.649622:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788509494.649710:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8844a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9006:1875387796829568:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788509494.650096:0:9006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509494.650179:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87c1e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788509494.650223:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796829568 00000100:00100000:1.0:1788509494.650231:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796829568 00000100:00100000:1.0:1788509494.650296:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788509494.650307:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8844b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9006:x1875387796829568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788509494.650653:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8844b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9006:x1875387796829568:12345-0@lo:1000:mdt00_003.0 Request processed in 346us (557us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788509494.650661:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788509494.650749:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8844a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9006:1875387796829568:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788509494.650877:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.650890:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651049:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651057:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.651062:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651071:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651090:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:0.0:1788509494.651094:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788509494.651100:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651107:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae400/0xe5156b86310de5aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651134:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651141:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651146:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651161:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afc00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509494.651165:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651171:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651179:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:0.0:1788509494.651182:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788509494.651186:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651192:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de4e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651218:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651236:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651246:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651279:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509494.651296:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 22 pid: 6520 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509494.651323:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796829696:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509494.651715:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87c1e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788509494.659860:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796829696:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509494.659918:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509494.660247:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509494.660393:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774756608 00000100:00100000:1.0:1788509494.660402:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774756608 00010000:00010000:1.0:1788509494.660463:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 23 pid: 6520 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509494.660516:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:1.0:1788509494.660528:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:2408:x1875387774756608:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509494.660545:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509494.660553:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 23 pid: 6520 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.660567:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 23 pid: 6520 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.660596:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310de502 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755330b expref: 23 pid: 6520 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.660611:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509494.660616:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.660628:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.660637:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.660679:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509494.660805:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:2408:x1875387774756608:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 278us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509494.660814:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00010000:00010000:1.0:1788509494.661053:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661061:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661076:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661083:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661090:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661096:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509494.661101:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661111:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661121:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509494.661124:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509494.661132:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661150:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de5b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661163:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661169:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661175:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661179:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509494.661182:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661187:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661195:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcdbd047600) 00010000:00010000:1.0:1788509494.661198:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788509494.661200:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.661206:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2400/0xe5156b86310de5a3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509494.661393:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12376:x1875387774756224:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 28285us (28791us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788509494.661403:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000020:00080000:1.0:1788509494.661414:0:9006:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788509494.661668:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509494.661674:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509494.662208:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788509494.662222:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788509494.666389:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509494.671223:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774756864 00000100:00100000:3.0:1788509494.671245:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774756864 00000100:00100000:3.0:1788509494.671335:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788509494.671348:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12376:x1875387774756864:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788509494.671814:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788509494.672211:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788509494.672262:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.672284:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.672299:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.672308:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.672315:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.672321:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509494.672952:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509494.673147:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509494.673157:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.673166:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afa00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509494.673171:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.673180:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.673209:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:3.0:1788509494.673213:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788509494.673219:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.673227:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de5b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509494.673239:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509494.673241:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509494.673243:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509494.673347:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:12376:x1875387774756864:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1996us (6966us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788509494.673358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000020:00080000:1.0:1788509494.673365:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788509495.190212:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509496.215083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509496.502239:0:14708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788509496.502251:0:14708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788509496.502279:0:14708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788509496.502286:0:14708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788509496.593224:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509496.593489:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774757120 00000100:00100000:3.0:1788509496.593502:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774757120 00000100:00100000:3.0:1788509496.593623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:3.0:1788509496.593636:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:12394:x1875387774757120:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509496.593669:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509496.593695:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de5bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553343 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.593991:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de5c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.594010:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de5c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.594025:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de5c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509496.594036:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788509496.594178:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de5bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553343 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.594198:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de5c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553343 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.594207:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:3.0:1788509496.594210:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788509496.594215:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9c00, rc 0) 00000100:00100000:3.0:1788509496.594293:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12394:x1875387774757120:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 659us (1081us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788509496.594303:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00080000:0.0:1788509496.595528:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509496.596582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509496.598249:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774757248 00000100:00100000:1.0:1788509496.598269:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774757248 00000100:00100000:1.0:1788509496.598353:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1788509496.598376:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12394:x1875387774757248:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1788509496.598506:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598528:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598543:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598560:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598567:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598574:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598668:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598677:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598685:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509496.598740:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598769:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598783:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598791:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598797:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afe00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509496.598803:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598811:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598825:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509496.598828:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509496.598833:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598839:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afe00/0xe5156b86310de5d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598853:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598858:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598864:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598868:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509496.598876:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598882:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598889:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ee00) 00010000:00010000:1.0:1788509496.598891:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509496.598893:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598925:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de5db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598942:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598948:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598953:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598958:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862aea00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509496.598961:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598967:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598975:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc8761ef00) 00010000:00010000:1.0:1788509496.598977:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509496.598986:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.598992:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de5e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509496.599102:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12394:x1875387774757248:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 728us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509496.599112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:3.0:1788509496.650552:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.651102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774757504 00000100:00100000:0.0:1788509496.651117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774757504 00000100:00100000:0.0:1788509496.651196:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:0.0:1788509496.651209:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12397:x1875387774757504:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509496.651236:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509496.651265:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de5e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755334a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651374:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651392:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651406:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651429:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651437:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651455:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651597:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651606:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651613:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509496.651625:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788509496.651733:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651742:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651750:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651756:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846fc00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509496.651762:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651781:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651795:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509496.651798:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509496.651804:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651812:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de5f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651829:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651835:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651842:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651847:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509496.651850:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651857:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651864:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc865bc400) 00010000:00010000:0.0:1788509496.651867:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509496.651869:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651884:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de5f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651965:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de5e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651983:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.651991:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:0.0:1788509496.651994:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509496.651997:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846e000, rc 0) 00000100:00100000:0.0:1788509496.652070:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12397:x1875387774757504:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 864us (1531us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788509496.652080:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:2.0:1788509496.656235:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509496.656297:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774757632 00000100:00100000:1.0:1788509496.656310:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774757632 00000100:00100000:1.0:1788509496.656401:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:1.0:1788509496.656413:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc870b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12397:x1875387774757632:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788509496.656513:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656536:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656552:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656598:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656607:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656614:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656620:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862aea00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509496.656642:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656652:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656667:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:1.0:1788509496.656671:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788509496.656676:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.656683:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de60c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509496.656767:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc870b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12397:x1875387774757632:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 356us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509496.656774:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:3.0:1788509496.659944:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509496.660255:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774757888 00000100:00100000:1.0:1788509496.660268:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774757888 00000100:00100000:1.0:1788509496.660386:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788509496.660399:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12397:x1875387774757888:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509496.660718:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+28:12397:x1875387774757888:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 321us (788us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788509496.660727:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788509496.706798:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509496.706934:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774758144 00000100:00100000:1.0:1788509496.706948:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774758144 00000100:00100000:1.0:1788509496.707024:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:1.0:1788509496.707034:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+28:11921:x1875387774758144:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788509496.707064:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509496.707101:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de613 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553351 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.707230:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.707243:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.707251:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.707283:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.707294:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 29 pid: 6521 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509496.707305:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87f50000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796829824:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509496.707419:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509496.710513:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87f50000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875387796829824:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509496.710572:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509496.711044:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509496.711259:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774758272 00000100:00100000:1.0:1788509496.711269:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774758272 00010000:00010000:1.0:1788509496.711319:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 30 pid: 6521 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509496.711384:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1788509496.711396:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:2407:x1875387774758272:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509496.711415:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509496.711423:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 30 pid: 6521 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.711438:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 30 pid: 6521 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.711475:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de5fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755334a expref: 30 pid: 6521 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.711495:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:1.0:1788509496.711501:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.711512:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.711520:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.711552:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509496.711612:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.711620:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509496.711643:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788509496.711868:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aea00/0xe5156b86310de613 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509496.711870:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+31:2407:x1875387774758272:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 476us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509496.711879:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00010000:00010000:3.0:1788509496.711887:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.711950:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:3.0:1788509496.711953:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788509496.711956:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae000, rc 0) 00000100:00100000:3.0:1788509496.711985:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:11921:x1875387774758144:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4953us (5203us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788509496.711993:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:3.0:1788509496.715066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509496.715201:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774758400 00000100:00100000:2.0:1788509496.715213:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774758400 00000100:00100000:2.0:1788509496.715281:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:2.0:1788509496.715293:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:11921:x1875387774758400:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509496.715322:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509496.715348:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3400/0xe5156b86310de628 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553358 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509496.715389:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de62f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509496.715427:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509496.715454:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509496.715669:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3400/0xe5156b86310de628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553358 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509496.715689:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de62f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553358 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509496.715699:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:2.0:1788509496.715702:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788509496.715707:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3c00, rc 0) 00000100:00100000:2.0:1788509496.716292:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:11921:x1875387774758400:12345-192.168.203.12@tcp:101:bash.0 Request processed in 996us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509496.716303:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:3.0:1788509496.724727:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.724851:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774758656 00000100:00100000:0.0:1788509496.724865:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774758656 00000100:00100000:0.0:1788509496.724979:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:0.0:1788509496.724992:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:11921:x1875387774758656:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1788509496.725337:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.725360:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.725374:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788509496.725463:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788509496.725489:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090c74daa reply state 00000000d99fca09 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.725503:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.725512:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:0.0:1788509496.725515:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509496.725520:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788509496.725566:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788509496.725694:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:11921:x1875387774758656:12345-192.168.203.12@tcp:36:bash.0 Request processed in 703us (978us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788509496.725702:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000020:00080000:0.0:1788509496.725709:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788509496.728678:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.730323:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774758784 00000100:00100000:0.0:1788509496.730397:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774758784 00000100:00100000:0.0:1788509496.730497:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:0.0:1788509496.730510:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+34:11921:x1875387774758784:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509496.730542:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509496.730571:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de63d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755335f expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.730648:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de63d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755335f expref: 35 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.730666:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de63d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755335f expref: 35 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.730714:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:0.0:1788509496.730717:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788509496.730723:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846fc00, rc 0) 00000100:00100000:0.0:1788509496.731006:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:11921:x1875387774758784:12345-192.168.203.12@tcp:101:bash.0 Request processed in 497us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509496.731014:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:2.0:1788509496.738821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509496.738965:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774758912 00000100:00100000:3.0:1788509496.738990:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774758912 00000100:00100000:3.0:1788509496.739103:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1788509496.739126:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:11921:x1875387774758912:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788509496.739152:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509496.739180:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553366 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509496.739222:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9a7d34, atime: 0x6a9a7d33, ctime: 0x6a9a7d34, blocks: 0x8 00010000:00010000:3.0:1788509496.739252:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1788509496.739258:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509496.739268:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.739288:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.739331:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8400, rc 0) 00000100:00100000:3.0:1788509496.739414:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:11921:x1875387774758912:12345-192.168.203.12@tcp:101:bash.0 Request processed in 292us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509496.739422:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00080000:0.0:1788509496.739523:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509496.742722:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.743529:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774759040 00000100:00100000:0.0:1788509496.743545:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774759040 00002000:00010000:1.0:1788509496.743818:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788509496.743826:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcd812a9f80 with x1875387774759040 ext(0->18446744073709551615) 00002000:00010000:1.0:1788509496.743841:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcd812a9f80. 00000100:00100000:1.0:1788509496.743961:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788509496.743974:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774759040:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:1.0:1788509496.744325:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788509496.744329:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788509492 -> 1788509496 00002000:00010000:1.0:1788509496.744332:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788509491 -> 1788509491 00002000:00010000:1.0:1788509496.744334:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788509492 -> 1788509496 00002000:00010000:1.0:1788509496.744336:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788509496.744422:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774759040:12345-192.168.203.12@tcp:10:bash.0 Request processed in 450us (1712us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788509496.744431:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00002000:00010000:1.0:1788509496.744435:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788509496.744437:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcd812a9f80 with x1875387774759040 ext(0->18446744073709551615) 00002000:00010000:1.0:1788509496.744453:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcd812a9f80. 00000100:00100000:1.0:1788509496.807556:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.807673:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774759168 00000100:00100000:0.0:1788509496.807686:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774759168 00000100:00100000:0.0:1788509496.807758:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:0.0:1788509496.807770:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12411:x1875387774759168:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788509496.807878:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.807937:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.807954:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.807973:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.807979:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.807987:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808102:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808113:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808119:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509496.808172:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808184:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808190:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808198:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808204:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509496.808210:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808219:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808232:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509496.808235:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509496.808241:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808255:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de64b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808274:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808280:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808285:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808290:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509496.808294:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808300:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808308:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc865bc400) 00010000:00010000:0.0:1788509496.808311:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509496.808313:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808319:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de652 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808335:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808342:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808353:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808359:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ec00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509496.808362:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808368:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808376:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:0.0:1788509496.808378:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509496.808381:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.808386:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de659 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509496.808503:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12411:x1875387774759168:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 732us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509496.808514:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:2.0:1788509496.853870:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509496.855601:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774759424 00000100:00100000:1.0:1788509496.855620:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774759424 00000100:00100000:1.0:1788509496.856148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:1.0:1788509496.856164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+35:12414:x1875387774759424:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509496.856305:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509496.856337:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de660 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755336d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856457:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856502:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856520:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856538:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856545:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856552:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856688:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de675 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856698:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de675 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.856706:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de675 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509496.856717:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788509496.857528:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857544:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857551:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857572:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509496.857578:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857587:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857604:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509496.857607:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509496.857612:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857619:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de667 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857636:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857642:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857647:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857652:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afa00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509496.857654:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857660:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857679:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ef00) 00010000:00010000:1.0:1788509496.857681:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509496.857684:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857691:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de66e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857752:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de660 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755336d expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.857768:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de675 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755336d expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509496.858481:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:1.0:1788509496.858487:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788509496.858618:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af400, rc 0) 00000100:00100000:1.0:1788509496.858802:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12414:x1875387774759424:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2639us (4952us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788509496.858814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:2.0:1788509496.863024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.863207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774759552 00000100:00100000:0.0:1788509496.863221:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774759552 00000100:00100000:0.0:1788509496.863296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1788509496.863308:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12414:x1875387774759552:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788509496.863413:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.863436:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.863475:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.863528:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.863545:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 37 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509496.863561:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796829952:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509496.863675:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509496.867045:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796829952:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509496.867092:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509496.872040:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509496.876468:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774759808 00000100:00100000:1.0:1788509496.876488:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774759808 00000100:00100000:1.0:1788509496.876638:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1788509496.876652:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:6179:x1875387774759808:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788509496.877186:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:6179:x1875387774759808:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 535us (5158us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788509496.877195:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788509496.882236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.882339:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774759936 00000100:00100000:0.0:1788509496.882361:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774759936 00010000:00010000:0.0:1788509496.882414:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 39 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509496.882472:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:0.0:1788509496.882484:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:2408:x1875387774759936:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509496.882504:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509496.882512:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 39 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.882551:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 39 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.882578:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310de61a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553351 expref: 39 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.882599:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:0.0:1788509496.882606:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.882618:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.882627:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.882668:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509496.883513:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:2408:x1875387774759936:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1025us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509496.883525:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00010000:00010000:3.0:1788509496.883782:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.883795:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.883848:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.883857:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.883864:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.883873:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ec00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509496.883878:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.883886:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.883922:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:3.0:1788509496.883941:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788509496.883948:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509496.883956:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de683 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509496.884051:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12414:x1875387774759552:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 20744us (21039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509496.884060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:2.0:1788509496.887540:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.887605:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774760192 00000100:00100000:0.0:1788509496.887618:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774760192 00000100:00100000:0.0:1788509496.887692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788509496.887703:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+37:12414:x1875387774760192:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788509496.888386:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12414:x1875387774760192:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 679us (857us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788509496.888396:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788509496.987159:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509496.987482:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774760448 00000100:00100000:0.0:1788509496.987496:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774760448 00000100:00100000:0.0:1788509496.987580:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:0.0:1788509496.987592:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+38:12425:x1875387774760448:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788509496.987626:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509496.987655:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de68a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553374 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.987775:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.987793:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.987807:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.987824:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.987832:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.987839:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988028:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de69f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988039:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de69f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988072:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de69f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509496.988085:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788509496.988188:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988197:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988204:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988210:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509496.988215:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988224:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988647:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509496.988651:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509496.988658:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988665:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de691 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988685:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988692:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988708:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988713:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ee00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509496.988716:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.988722:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.989537:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc865bc400) 00010000:00010000:0.0:1788509496.989546:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509496.989555:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.989564:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de698 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.989652:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de68a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553374 expref: 41 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.989670:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de69f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553374 expref: 40 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509496.989679:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:0.0:1788509496.989681:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509496.989683:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846f800, rc 0) 00000100:00100000:0.0:1788509496.989801:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+40:12425:x1875387774760448:12345-192.168.203.12@tcp:101:cat.0 Request processed in 2210us (2655us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788509496.989828:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1788509496.998056:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.000640:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774760704 00000100:00100000:0.0:1788509497.000661:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774760704 00000100:00100000:0.0:1788509497.000762:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788509497.000773:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+40:12425:x1875387774760704:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1788509497.001318:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc811cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+41:12425:x1875387774760704:12345-192.168.203.12@tcp:35:cat.0 Request processed in 542us (3275us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788509497.001328:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:3.0:1788509497.027296:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.027376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774760960 00000100:00100000:1.0:1788509497.027389:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774760960 00000100:00100000:1.0:1788509497.027479:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:1.0:1788509497.027492:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+41:12426:x1875387774760960:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1788509497.027571:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788509497.027608:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de63d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755335f expref: 41 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027638:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de69f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553374 expref: 40 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027653:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af400/0xe5156b86310de675 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755336d expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027667:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de62f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553358 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027679:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:1.0:1788509497.027685:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788509497.027715:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027732:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027756:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027773:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027801:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027808:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027955:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027964:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.027972:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788509497.028849:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788509497.028868:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394189968633ns, next at 395189964893ns, rc = 0 00010000:00010000:1.0:1788509497.032968:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033127:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033142:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033153:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033159:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033350:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033383:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788509497.033417:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033424:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033431:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033445:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509497.033451:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033459:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033474:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:1.0:1788509497.033477:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788509497.033483:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033489:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae600/0xe5156b86310de6bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033517:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033524:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033537:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033544:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509497.033546:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033553:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033563:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509497.033566:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509497.033569:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033575:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af800/0xe5156b86310de6ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509497.033588:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004771aa95 reply state 0000000001997a6c transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033601:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.033608:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ef00) 00010000:00010000:1.0:1788509497.033610:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509497.033614:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788509497.033845:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509497.033853:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.033872:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afc00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509497.033876:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.033883:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.033893:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:2.0:1788509497.033930:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788509497.033934:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.033941:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afc00/0xe5156b86310de6c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.033955:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509497.033956:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509497.033958:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509497.034564:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:12426:x1875387774760960:12345-192.168.203.12@tcp:36:rm.0 Request processed in 7064us (7273us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788509497.034575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:3.0:1788509497.046238:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796830080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509497.046338:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509497.047065:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796830080 00000100:00100000:1.0:1788509497.047086:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796830080 00000100:00100000:1.0:1788509497.047155:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788509497.047166:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796830080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509497.047214:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509497.047298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796830080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.047306:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788509497.047322:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796830080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509497.078007:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.078521:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774761216 00000100:00100000:1.0:1788509497.078536:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774761216 00000100:00100000:0.0:1788509497.079304:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:0.0:1788509497.079322:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+39:12432:x1875387774761216:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509497.079366:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.079396:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de6c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755337b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.079546:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.079566:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.079580:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.079593:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.079600:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.079627:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788509497.080506:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788509497.080692:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.080708:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.080719:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.080764:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.080771:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.080996:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.081003:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ee00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.081008:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.081016:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.081032:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509497.081035:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509497.081057:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.081064:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de6d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509497.081156:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006acd6e5e reply state 00000000123c7011 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.081172:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.081179:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ef00) 00010000:00010000:0.0:1788509497.081182:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509497.081186:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788509497.081227:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de6c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.081245:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.081253:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcc865bc400) 00010000:00010000:0.0:1788509497.081255:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509497.081258:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846fe00, rc 0) 00000100:00100000:0.0:1788509497.081368:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+42:12432:x1875387774761216:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2051us (3374us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788509497.081378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:3.0:1788509497.084600:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.084693:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774761344 00000100:00100000:2.0:1788509497.084705:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774761344 00000100:00080000:3.0:1788509497.084779:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788509497.084873:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1788509497.084887:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2409:x1875387774761344:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509497.085043:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509497.085070:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553382 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509497.085180:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509497.085227:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788509497.085233:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509497.085245:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.085270:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.085286:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2800, rc 0) 00000100:00100000:2.0:1788509497.085417:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2409:x1875387774761344:12345-192.168.203.12@tcp:101:bash.0 Request processed in 532us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.085424:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1788509497.090309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.090483:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774761472 00000100:00100000:3.0:1788509497.090496:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774761472 00000100:00100000:3.0:1788509497.090608:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788509497.090621:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:12432:x1875387774761472:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788509497.090648:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509497.090673:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553389 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.090716:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.090751:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509497.090756:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509497.090763:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.090815:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.090830:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 9 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.090847:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1875387796830208:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509497.091011:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5980180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509497.093545:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1875387796830208:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509497.093652:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.093680:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8e00, rc 0) 00000100:00100000:3.0:1788509497.094074:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:12432:x1875387774761472:12345-192.168.203.12@tcp:101:bash.0 Request processed in 3452us (3777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.094141:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788509497.095165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.095415:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774761600 00000100:00100000:3.0:1788509497.095427:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774761600 00010000:00010000:3.0:1788509497.095490:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 9 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.095645:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:3.0:1788509497.095657:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8844aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774761600:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509497.095676:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509497.095704:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 9 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.095725:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 9 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.095755:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc394abd/0xe5156b86310de6ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553382 expref: 9 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.095773:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509497.095783:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509497.095794:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.095806:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.095853:0:7472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.095870:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7472:1875387796830336:192.168.203.12@tcp:105: 00000100:00100000:3.0:1788509497.096710:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5980180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509497.099267:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7472:1875387796830336:192.168.203.12@tcp:105: 00010000:00010000:3.0:1788509497.099300:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509497.099449:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8844aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774761600:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 3784us (4281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.099464:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1788509497.102184:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.102293:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774761856 00000100:00100000:0.0:1788509497.102305:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774761856 00000100:00100000:0.0:1788509497.102406:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1788509497.102418:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+42:12432:x1875387774761856:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788509497.103048:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12432:x1875387774761856:12345-192.168.203.12@tcp:35:bash.0 Request processed in 630us (875us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788509497.103057:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00010000:00010000:3.0:1788509497.238525:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509497.256987:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.257237:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774761984 00000100:00100000:3.0:1788509497.257261:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774761984 00000100:00100000:3.0:1788509497.257352:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:3.0:1788509497.257364:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+43:12448:x1875387774761984:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509497.257397:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509497.257425:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de6fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553390 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.257531:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de701 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.257550:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de701 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.257565:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de701 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509497.257627:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788509497.257632:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788509497.257657:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de701 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.257713:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de6fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553390 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.257735:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de701 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553390 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.257745:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:3.0:1788509497.257748:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788509497.257753:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9200, rc 0) 00000100:00100000:3.0:1788509497.258644:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12448:x1875387774761984:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1275us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.258654:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1788509497.266995:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.268139:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774762240 00000100:00100000:0.0:1788509497.268158:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774762240 00000100:00100000:0.0:1788509497.268370:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:0.0:1788509497.268385:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+44:12448:x1875387774762240:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509497.268414:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.268453:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de708 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553397 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.268597:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de70f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.268615:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de70f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.268629:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de70f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509497.268642:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788509497.268791:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ee00/0xe5156b86310de708 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553397 expref: 47 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.268818:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de70f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553397 expref: 46 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.268862:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcc865bc400) 00010000:00010000:0.0:1788509497.268866:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509497.268870:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846e400, rc 0) 00000100:00100000:0.0:1788509497.269008:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+46:12448:x1875387774762240:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 627us (2028us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788509497.269016:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:2.0:1788509497.274537:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.277121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774762496 00000100:00100000:3.0:1788509497.277141:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774762496 00000100:00100000:3.0:1788509497.277227:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:3.0:1788509497.277240:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+46:12448:x1875387774762496:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509497.277284:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509497.277313:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de71d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755339e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.277478:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de724 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.277497:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.277512:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509497.277545:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788509497.277677:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de71d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755339e expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.277700:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de724 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755339e expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.277710:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcc865bc400) 00010000:00010000:3.0:1788509497.277714:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788509497.277718:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031a00, rc 0) 00000100:00100000:3.0:1788509497.278714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+48:12448:x1875387774762496:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1469us (4185us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788509497.278725:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:2.0:1788509497.279463:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.284223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.284369:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774762752 00000100:00100000:3.0:1788509497.284384:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774762752 00000100:00100000:3.0:1788509497.284471:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788509497.284483:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8844ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774762752:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:3.0:1788509497.284546:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.284573:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.284583:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509497.284589:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509497.284595:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.284663:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.284682:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 8 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.284701:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875387796830464:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509497.284829:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5980b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509497.287934:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875387796830464:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509497.287974:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.289360:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774762624 00000100:00100000:1.0:1788509497.289377:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774762624 00000100:00100000:1.0:1788509497.289483:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788509497.289496:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+48:2409:x1875387774762624:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509497.289516:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509497.289548:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de70f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553397 expref: 48 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.289576:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcc865bc400) 00010000:00010000:1.0:1788509497.289583:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509497.289670:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+47:2409:x1875387774762624:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 176us (10209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.289679:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788509497.291733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.291876:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774762880 00000100:00100000:1.0:1788509497.291887:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774762880 00002000:00100000:1.0:1788509497.291979:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8bcc88426680 x1875387774762880/t0(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:578/0 lens 504/0 e 0 to 0 dl 1788509508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509497.292007:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc88426680 with x1875387774762880 ext(0->8) 00010000:00010000:1.0:1788509497.292020:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 9 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.292040:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 9 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788509497.292049:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bcc88426680 00000100:00100000:1.0:1788509497.292096:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788509497.292108:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2407:x1875387774762880:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:1.0:1788509497.293488:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:2407:x1875387774762880:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 1372us (1756us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788509497.293502:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:1.0:1788509497.293513:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8bcc88426680 x1875387774762880/t4294967309(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:578/0 lens 504/448 e 0 to 0 dl 1788509508 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509497.293524:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc88426680 with x1875387774762880 ext(0->8) 00010000:00010000:1.0:1788509497.293534:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 11 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.293552:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 11 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788509497.293561:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bcc88426680 00000001:00080000:2.0:1788509497.298273:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1788509497.298296:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1788509497.300397:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.300476:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774763008 00000100:00100000:1.0:1788509497.300510:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774763008 00010000:00010000:1.0:1788509497.300568:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 7 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.300630:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1788509497.300643:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2410:x1875387774763008:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509497.300669:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788509497.300693:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788509497.300697:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788509496 00002000:00010000:1.0:1788509497.300699:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788509496 00002000:00010000:1.0:1788509497.300702:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788509496 00002000:00010000:1.0:1788509497.300705:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788509497.300713:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 7 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.300733:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 7 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.300764:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88e0ad7/0xe5156b86310de6f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553389 expref: 7 pid: 8438 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.300797:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509497.300803:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509497.300811:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.300823:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.300883:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509497.301608:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.301624:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.301659:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.301687:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.301697:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.301705:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509497.301711:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.301722:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.301739:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.301748:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000667bfb87/0xe5156b86310de732 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.302116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+6:2410:x1875387774763008:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1469us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.302128:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788509497.302422:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8844ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774762752:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 17940us (18213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.302433:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788509497.305758:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.306054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774763264 00000100:00100000:0.0:1788509497.306068:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774763264 00000100:00100000:0.0:1788509497.306209:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788509497.306222:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+47:12448:x1875387774763264:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:0.0:1788509497.306308:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de724 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755339e expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788509497.306667:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788509497.306699:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788509497.307525:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788509497.307582:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.307605:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.307617:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.307664:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.307696:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 51 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.307714:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88448000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875387796830592:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509497.308044:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d42600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509497.311667:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.311746:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774763392 00000100:00100000:2.0:1788509497.311758:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774763392 00010000:00010000:2.0:1788509497.311816:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 52 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.311891:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1788509497.311923:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8844bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+52:2407:x1875387774763392:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509497.311942:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509497.311950:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 52 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.311964:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 52 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.311992:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcc865bc400) 00010000:00010000:2.0:1788509497.311998:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.312009:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.312018:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.312042:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509497.312126:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8844bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+52:2407:x1875387774763392:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 205us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.312134:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00010000:00010000:1.0:1788509497.314309:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de6de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e464755337b expref: 51 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.314409:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88448000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875387796830592:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509497.314580:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.314593:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.314600:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788509497.315263:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1788509497.315510:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788509497.315640:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87366a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796830720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788509497.315732:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509497.315859:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788509497.316207:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796830720 00000100:00100000:0.0:1788509497.316217:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796830720 00000100:00100000:0.0:1788509497.316488:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788509497.316501:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796830720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788509497.316642:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796830720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.316650:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1788509497.316688:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509497.316784:0:6523:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1788509497.316792:0:6523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1788509497.316820:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcc87dfd880, transno 4294967308 00000100:00100000:1.0:1788509497.316845:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87366a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796830720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788509497.317062:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788509497.317334:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87366a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796830848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788509497.317402:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509497.317789:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509497.319446:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796830848 00000100:00100000:2.0:1788509497.319463:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796830848 00000100:00100000:2.0:1788509497.319542:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788509497.319552:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875387796830848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788509497.320044:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1875387796830848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 492us (2641us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788509497.320054:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788509497.320419:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87366a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875387796830848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788509497.320521:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788509497.320580:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.320593:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.320602:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.320609:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509497.320614:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.320623:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.320643:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcc865bc400) 00010000:00010000:1.0:1788509497.320647:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788509497.320652:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.320659:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de739 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788509497.320806:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788509497.320892:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788509497.320947:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394482048273ns, next at 395482044900ns, rc = 0 00000001:00080000:1.0:1788509497.320956:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788509497.320982:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcc865bc400) 00010000:00010000:1.0:1788509497.320985:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788509497.320993:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de724 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755339e expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.321589:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:12448:x1875387774763264:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 15365us (15840us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788509497.321600:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000020:00080000:0.0:1788509497.321606:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788509497.324891:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.325200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774763520 00000100:00100000:2.0:1788509497.325213:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774763520 00000100:00100000:2.0:1788509497.325321:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:2.0:1788509497.325333:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8844b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+54:12448:x1875387774763520:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509497.325371:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509497.325401:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de740 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.325492:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de740 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533a5 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.325509:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de740 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533a5 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.325531:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509497.325534:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509497.325538:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2a00, rc 0) 00000100:00100000:2.0:1788509497.325616:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8844b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+55:12448:x1875387774763520:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 285us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.325625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:3.0:1788509497.327861:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.328187:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774763776 00000100:00100000:1.0:1788509497.328199:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774763776 00000100:00100000:1.0:1788509497.328265:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788509497.328274:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+55:12448:x1875387774763776:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509497.328556:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+56:12448:x1875387774763776:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 281us (714us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788509497.328563:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788509497.403746:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.403988:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774763904 00000100:00100000:1.0:1788509497.404002:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774763904 00000100:00100000:1.0:1788509497.404085:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1788509497.404099:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+56:12458:x1875387774763904:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1788509497.404200:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404224:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404239:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404252:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404282:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404290:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404407:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404416:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404423:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509497.404495:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404512:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404520:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404528:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404534:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862aee00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509497.404540:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404549:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404569:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509497.404572:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509497.404578:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404586:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862aee00/0xe5156b86310de747 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404601:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404607:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404614:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404620:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509497.404623:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404629:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404637:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ef00) 00010000:00010000:1.0:1788509497.404639:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509497.404642:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404648:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae800/0xe5156b86310de74e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404667:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404674:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404679:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404684:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509497.404687:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404694:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404702:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509497.404705:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509497.404708:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.404714:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de755 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.405289:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+56:12458:x1875387774763904:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1187us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.405301:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1788509497.441478:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.441638:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774764160 00000100:00100000:0.0:1788509497.441650:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774764160 00000100:00100000:0.0:1788509497.441724:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:0.0:1788509497.441734:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+56:12461:x1875387774764160:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509497.441760:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.441795:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de75c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533ac expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442139:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442157:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442170:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442180:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442188:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442194:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442330:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442338:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442357:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509497.442368:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788509497.442482:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442490:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442505:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442511:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.442516:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442525:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442540:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509497.442543:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509497.442549:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442556:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de763 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442574:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442580:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442586:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442591:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.442594:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442610:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442619:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ef00) 00010000:00010000:0.0:1788509497.442621:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509497.442625:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442631:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de76a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442676:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de75c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 59 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442693:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 58 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.442701:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:0.0:1788509497.442703:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509497.442706:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846fe00, rc 0) 00000100:00100000:0.0:1788509497.443167:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+58:12461:x1875387774764160:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1431us (1701us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788509497.443177:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:3.0:1788509497.446293:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.446576:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774764288 00000100:00100000:1.0:1788509497.446590:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774764288 00000100:00100000:1.0:1788509497.446690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:1.0:1788509497.446702:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+58:12461:x1875387774764288:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788509497.446804:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.446825:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.446838:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.446885:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.446894:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.450679:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.450690:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509497.450696:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.450707:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.450732:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509497.450736:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788509497.450742:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.450839:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de77f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.451133:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+58:12461:x1875387774764288:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 4427us (4847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.451145:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:3.0:1788509497.454050:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.454163:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774764544 00000100:00100000:1.0:1788509497.454184:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774764544 00000100:00100000:1.0:1788509497.454257:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1788509497.454269:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+58:12461:x1875387774764544:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788509497.454585:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+59:12461:x1875387774764544:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 317us (548us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788509497.454593:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788509497.530514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.530638:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774764800 00000100:00100000:0.0:1788509497.530651:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774764800 00000100:00100000:0.0:1788509497.530734:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:0.0:1788509497.530748:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+59:12471:x1875387774764800:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509497.530815:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.530819:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788509497.530870:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de701 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553390 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.530895:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509497.530954:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509497.530972:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de786 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.531111:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.531128:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 59 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.531138:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.531181:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 59 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.531198:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 59 pid: 9006 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.531214:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796830976:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509497.531331:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509497.535478:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.535698:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796830976:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509497.535753:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.536030:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774764928 00000100:00100000:2.0:1788509497.536039:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774764928 00010000:00010000:2.0:1788509497.536086:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 60 pid: 9006 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.536180:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:2.0:1788509497.536192:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:2407:x1875387774764928:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509497.536210:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509497.536218:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 60 pid: 9006 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.536234:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 60 pid: 9006 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.536261:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fe00/0xe5156b86310de771 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ac expref: 60 pid: 9006 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.536281:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509497.536286:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.536297:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.536305:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.536337:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509497.536419:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.536427:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509497.536458:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788509497.536642:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de786 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.536662:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.536671:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:0.0:1788509497.536673:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788509497.536676:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846f400, rc 0) 00000100:00100000:0.0:1788509497.536762:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:12471:x1875387774764800:12345-192.168.203.12@tcp:101:bash.0 Request processed in 6016us (6262us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788509497.536779:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1788509497.537958:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+59:2407:x1875387774764928:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1653us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.537970:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:3.0:1788509497.540946:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.541067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774765056 00000100:00100000:0.0:1788509497.541080:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774765056 00000100:00100000:0.0:1788509497.541145:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:0.0:1788509497.541157:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+59:12471:x1875387774765056:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509497.541188:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.541217:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de79b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.541283:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.541301:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.541315:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.541478:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de79b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.541503:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.541514:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:0.0:1788509497.541517:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788509497.541521:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846fa00, rc 0) 00000100:00100000:0.0:1788509497.541594:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:12471:x1875387774765056:12345-192.168.203.12@tcp:101:bash.0 Request processed in 438us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.541602:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:3.0:1788509497.544689:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.544812:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774765312 00000100:00100000:0.0:1788509497.544825:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774765312 00000100:00100000:0.0:1788509497.544936:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:0.0:1788509497.544950:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+60:12471:x1875387774765312:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1788509497.545252:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.545287:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.545302:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788509497.545355:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788509497.545383:0:9006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3c80770 reply state 00000000812e9436 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.545398:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.545408:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:0.0:1788509497.545411:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509497.545415:0:9006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788509497.545569:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:12471:x1875387774765312:12345-192.168.203.12@tcp:36:bash.0 Request processed in 620us (890us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788509497.545578:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000020:00080000:0.0:1788509497.545607:0:9006:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788509497.548467:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.548793:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774765440 00000100:00100000:0.0:1788509497.548807:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774765440 00000100:00100000:0.0:1788509497.548873:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:0.0:1788509497.548885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:12471:x1875387774765440:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788509497.548936:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.548965:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de7b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533c1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.549086:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.549121:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.549132:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.549175:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.549192:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 64 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.549208:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796831104:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509497.549311:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509497.552679:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796831104:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509497.552723:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.553217:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.553543:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774765568 00000100:00100000:2.0:1788509497.553569:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774765568 00010000:00010000:2.0:1788509497.553623:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 65 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.553669:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1788509497.553680:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:2408:x1875387774765568:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509497.553699:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509497.553707:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 65 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.553721:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 65 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.553749:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de78d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533b3 expref: 65 pid: 6520 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.553781:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509497.553786:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.553798:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.553806:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.553844:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509497.553944:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+64:2408:x1875387774765568:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 265us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.553964:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00010000:00010000:1.0:1788509497.554245:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.554255:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509497.554329:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788509497.554334:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509497.554373:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.554417:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de7b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.554444:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.554463:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509497.554466:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509497.554469:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846ea00, rc 0) 00000100:00100000:1.0:1788509497.554519:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:12471:x1875387774765440:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5635us (6064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.554526:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:3.0:1788509497.557870:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.558191:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774765824 00000100:00100000:1.0:1788509497.558205:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774765824 00000100:00100000:1.0:1788509497.558270:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788509497.558282:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+63:12471:x1875387774765824:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1788509497.558592:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+64:12471:x1875387774765824:12345-192.168.203.12@tcp:35:bash.0 Request processed in 311us (744us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788509497.558601:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788509497.558742:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509497.558762:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796831232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509497.558829:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509497.558878:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796831232 00000100:00100000:2.0:1788509497.558883:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796831232 00000100:00100000:2.0:1788509497.558946:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788509497.558955:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796831232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788509497.558975:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788509497.559015:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796831232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.559022:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788509497.559077:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796831232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509497.560616:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796831488:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.560684:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.560725:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796832000:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.560756:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.560788:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796832512:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.560814:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.560840:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788509497.560868:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796831616:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.560921:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.560942:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796832128:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.560966:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.560982:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796832640:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.561038:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796831488 00000100:00100000:0.0:1788509497.561046:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796831488 00000100:00100000:0.0:1788509497.561101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788509497.561110:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796831488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561168:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796831488:12345-0@lo:400:kworker.0 Request processed in 58us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.561176:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788509497.561212:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796831360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509497.561243:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.561262:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc811cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796831872:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561285:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.561295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796832384:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561321:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.561342:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788509497.561348:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796831744:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561370:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.561388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc870b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796832256:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561408:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.561423:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796832768:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561470:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.561501:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796831360 00000100:00100000:0.0:1788509497.561506:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796831360 00000100:00100000:0.0:1788509497.561530:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796831744 00000100:00100000:0.0:1788509497.561533:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796831744 00000100:00100000:0.0:1788509497.561546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788509497.561553:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875387796831360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509497.561591:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788509497.561635:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875387796831360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.561642:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788509497.561655:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788509497.561661:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796831744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561691:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796831744:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.561698:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788509497.561719:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796832384 00000100:00100000:0.0:1788509497.561723:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796832384 00000100:00100000:0.0:1788509497.561755:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796832256 00000100:00100000:0.0:1788509497.561758:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796832256 00000100:00100000:0.0:1788509497.561768:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796832768 00000100:00100000:0.0:1788509497.561770:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796832768 00000100:00100000:0.0:1788509497.561788:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788509497.561794:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796832384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561826:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796832384:12345-0@lo:400:kworker.0 Request processed in 32us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.561833:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788509497.561844:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788509497.561859:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796832256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561891:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796832256:12345-0@lo:400:kworker.0 Request processed in 33us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.561922:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788509497.561935:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788509497.561941:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796832768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.561971:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796832768:12345-0@lo:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.561978:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788509497.562016:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796831488:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562057:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796831744:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562068:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc870b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796832256:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562077:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796832768:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562091:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796831360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509497.562102:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796832384:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562141:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796832000 00000100:00100000:0.0:1788509497.562145:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796832000 00000100:00100000:0.0:1788509497.562170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796832512 00000100:00100000:0.0:1788509497.562173:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796832512 00000100:00100000:0.0:1788509497.562187:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796831616 00000100:00100000:0.0:1788509497.562190:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796831616 00000100:00100000:0.0:1788509497.562200:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796832128 00000100:00100000:0.0:1788509497.562204:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796832128 00000100:00100000:0.0:1788509497.562216:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796832640 00000100:00100000:0.0:1788509497.562219:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796832640 00000100:00100000:0.0:1788509497.562243:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796831872 00000100:00100000:0.0:1788509497.562246:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796831872 00000100:00100000:0.0:1788509497.562259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788509497.562265:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796832000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562307:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796832000:12345-0@lo:400:kworker.0 Request processed in 42us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.562314:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788509497.562326:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788509497.562332:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb78a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796832512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562361:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb78a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796832512:12345-0@lo:400:kworker.0 Request processed in 29us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.562368:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788509497.562379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788509497.562385:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796831616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562413:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796831616:12345-0@lo:400:kworker.0 Request processed in 28us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.562418:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788509497.562429:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788509497.562445:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796832128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796832128:12345-0@lo:400:kworker.0 Request processed in 41us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.562483:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788509497.562495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788509497.562501:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796832640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562529:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796832640:12345-0@lo:400:kworker.0 Request processed in 29us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.562542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788509497.562555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788509497.562561:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796831872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562594:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796831872:12345-0@lo:400:kworker.0 Request processed in 34us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.562600:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788509497.562623:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796831872:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562648:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796831616:0@lo:400:kworker.0 00010000:00080000:0.0:1788509497.562662:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb789b100 x1875387796832128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509497.562673:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796832128:0@lo:400:kworker.0 00010000:00080000:0.0:1788509497.562684:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc865dd880 x1875387796832640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509497.562692:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796832640:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562704:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc811cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796832000:0@lo:400:kworker.0 00000100:00100000:0.0:1788509497.562714:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796832512:0@lo:400:kworker.0 00000100:00080000:3.0:1788509497.562984:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509497.562989:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509497.562992:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509497.562995:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509497.563264:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509497.563280:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796832896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509497.563335:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509497.563426:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796832896 00000100:00100000:2.0:1788509497.563443:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796832896 00000100:00100000:2.0:1788509497.563484:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788509497.563493:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796832896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788509497.563514:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788509497.563570:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796832896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.563577:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788509497.565101:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796832896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509497.608955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.609252:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774765952 00000100:00100000:0.0:1788509497.609266:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774765952 00000100:00100000:0.0:1788509497.609353:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:0.0:1788509497.609366:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd83e2c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+64:12477:x1875387774765952:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509497.609399:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.609426:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de7be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533c8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.609546:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de7c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.609563:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.609577:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509497.609633:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788509497.609637:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509497.609660:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.609691:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310de7be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c8 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.609716:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c8 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.609727:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509497.609730:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509497.609734:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846e600, rc 0) 00000100:00100000:0.0:1788509497.609886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd83e2c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:12477:x1875387774765952:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 522us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.609894:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:3.0:1788509497.616016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.616194:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774766080 00000100:00100000:0.0:1788509497.616208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774766080 00000100:00100000:0.0:1788509497.616297:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:0.0:1788509497.616308:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:12477:x1875387774766080:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509497.616337:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.616367:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de7cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616465:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616485:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616499:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616512:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616520:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616527:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616621:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de7e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616631:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616637:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509497.616701:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788509497.616706:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509497.616727:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616739:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616748:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616755:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616762:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616779:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.616785:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616793:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616807:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509497.616810:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509497.616816:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616824:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de7d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616853:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616860:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616866:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616871:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.616874:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616881:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616889:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ef00) 00010000:00010000:0.0:1788509497.616892:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509497.616942:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616949:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.616983:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de7cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533cf expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.617000:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533cf expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.617019:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:0.0:1788509497.617022:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509497.617024:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846fc00, rc 0) 00000100:00100000:0.0:1788509497.617105:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:12477:x1875387774766080:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 799us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.617115:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:3.0:1788509497.621368:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.621496:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774766208 00000100:00100000:1.0:1788509497.621509:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774766208 00000100:00100000:1.0:1788509497.621595:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788509497.621606:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89172050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:2408:x1875387774766208:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509497.621627:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509497.621659:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fc00/0xe5156b86310de7e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533cf expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.621709:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509497.621715:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509497.621795:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89172050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:2408:x1875387774766208:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 191us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.621804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788509497.624735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.624934:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774766464 00000100:00100000:2.0:1788509497.624946:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774766464 00000100:00100000:2.0:1788509497.625017:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:2.0:1788509497.625028:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:12477:x1875387774766464:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509497.625076:0:9006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509497.625105:0:9006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de7e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533d6 expref: -99 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.625254:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.625275:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.625285:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.625327:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.625344:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 66 pid: 6521 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.625360:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88426a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796833024:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509497.625494:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509497.629091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.629197:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774766592 00000100:00100000:1.0:1788509497.629209:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774766592 00010000:00010000:1.0:1788509497.629265:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 67 pid: 6521 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.629317:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:1.0:1788509497.629329:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:2408:x1875387774766592:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509497.629357:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509497.629367:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 67 pid: 6521 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.629384:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 67 pid: 6521 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.629413:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509497.629420:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.629431:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.629451:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.629495:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509497.629566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:2408:x1875387774766592:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 238us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.629575:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00010000:00010000:2.0:1788509497.630419:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310de7b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c1 expref: 66 pid: 6521 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.630454:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88426a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796833024:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509497.630481:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.630506:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.630513:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509497.630537:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788509497.630689:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3200/0xe5156b86310de7e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 67 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.630705:0:9006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 66 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.630713:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509497.630716:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788509497.630719:0:9006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3000, rc 0) 00000100:00100000:2.0:1788509497.630778:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:12477:x1875387774766464:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 5741us (6046us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788509497.630786:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:3.0:1788509497.634807:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.634957:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774766848 00000100:00100000:1.0:1788509497.634970:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774766848 00000100:00100000:1.0:1788509497.635055:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788509497.635068:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:12477:x1875387774766848:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:1.0:1788509497.635088:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509497.635121:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2a00/0xe5156b86310de740 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533a5 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.635145:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509497.635152:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509497.635218:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:12477:x1875387774766848:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 151us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.635226:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788509497.637533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.637640:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774766976 00000100:00100000:0.0:1788509497.637653:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774766976 00000100:00100000:0.0:1788509497.637727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:0.0:1788509497.637738:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:12477:x1875387774766976:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:0.0:1788509497.637970:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.637994:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.638010:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788509497.638141:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788509497.638242:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:12477:x1875387774766976:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 505us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.638251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:0.0:1788509497.641278:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.641386:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774767104 00000100:00100000:3.0:1788509497.641399:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774767104 00000100:00100000:3.0:1788509497.641542:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:3.0:1788509497.641555:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+65:12477:x1875387774767104:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509497.641582:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509497.641611:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533dd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.641688:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.641701:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.641724:0:6522:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.641738:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.641786:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:3.0:1788509497.641790:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788509497.641795:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.641804:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031a00, rc 0) 00000100:00100000:3.0:1788509497.641880:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:12477:x1875387774767104:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 329us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.641888:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00000040:00080000:0.0:1788509497.750489:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509497.750503:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509497.750537:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788509497.750570:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788509497.750752:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796833152:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788509497.751118:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509497.758530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.758655:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774767232 00000100:00100000:2.0:1788509497.758668:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774767232 00000100:00100000:2.0:1788509497.758748:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:2.0:1788509497.758759:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:12478:x1875387774767232:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788509497.758816:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788509497.758991:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:12478:x1875387774767232:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 232us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.759000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:1.0:1788509497.761531:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796833152:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788509497.762402:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.762554:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774767360 00000100:00100000:2.0:1788509497.762564:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774767360 00000100:00100000:2.0:1788509497.762630:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:2.0:1788509497.762642:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:12478:x1875387774767360:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788509497.762742:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.762765:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.762964:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.762987:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.762995:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763002:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763034:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763045:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763052:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509497.763113:0:9006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788509497.763136:0:9006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509497.763154:0:9006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763170:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763177:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763185:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763193:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.763198:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763206:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763220:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:2.0:1788509497.763223:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509497.763229:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763236:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2c00/0xe5156b86310de80b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763253:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763258:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763274:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763279:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.763282:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763288:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763296:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8bcdbd047300) 00010000:00010000:2.0:1788509497.763299:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509497.763302:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763308:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de812 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763325:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763332:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763408:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763415:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.763418:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763446:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763456:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509497.763458:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509497.763462:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.763469:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de819 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.763650:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:12478:x1875387774767360:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1007us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.763660:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:0.0:1788509497.772610:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.774497:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774767616 00000100:00100000:2.0:1788509497.774516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774767616 00000100:00100000:2.0:1788509497.774606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:2.0:1788509497.774619:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+66:12478:x1875387774767616:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509497.774648:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509497.774676:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de820 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.774891:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.774984:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.774998:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509497.775031:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788509497.775134:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775143:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775151:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775157:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.775163:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775173:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775188:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509497.775192:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788509497.775198:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775204:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de827 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775256:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de820 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533e4 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775268:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:2.0:1788509497.775271:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788509497.775283:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de820 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533e4 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.775293:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3c00, rc 0) 00000100:00100000:2.0:1788509497.776144:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:12478:x1875387774767616:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1519us (3540us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788509497.776154:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:3.0:1788509497.780313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.780669:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774767744 00000100:00100000:1.0:1788509497.780682:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774767744 00000100:00100000:1.0:1788509497.780767:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:1.0:1788509497.781013:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:12478:x1875387774767744:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788509497.781061:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788509497.781205:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:12478:x1875387774767744:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 195us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.788602:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.788709:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774768000 00000100:00100000:2.0:1788509497.788722:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774768000 00000100:00100000:1.0:1788509497.791502:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:2.0:1788509497.792554:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:2.0:1788509497.792587:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:12478:x1875387774768000:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509497.792619:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509497.792622:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788509497.792660:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310de7c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533c8 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.792688:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:2.0:1788509497.792695:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509497.792715:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de835 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788509497.793263:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788509497.793543:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de83c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.793561:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de83c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.793574:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de83c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.793661:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de835 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533eb expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.793681:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de83c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533eb expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.793689:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047300) 00010000:00010000:2.0:1788509497.793693:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509497.793696:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2800, rc 0) 00000100:00100000:2.0:1788509497.793785:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+68:12478:x1875387774768000:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1215us (5197us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788509497.793794:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:3.0:1788509497.796766:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.796874:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774768256 00000100:00100000:0.0:1788509497.796887:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774768256 00000100:00100000:0.0:1788509497.796993:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:0.0:1788509497.797005:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+68:12478:x1875387774768256:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788509497.797078:0:9006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509497.797110:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2800/0xe5156b86310de83c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533eb expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797131:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047300) 00010000:00010000:0.0:1788509497.797144:0:9006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509497.797170:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797187:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797198:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797214:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797221:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797227:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797298:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797307:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797314:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797321:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ec00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.797326:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797334:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797482:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:0.0:1788509497.797487:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509497.797493:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797500:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de84a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797513:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797623:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797631:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797643:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.797647:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797654:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797662:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x2f44a232 (ffff8bcc865bcb00) 00010000:00010000:0.0:1788509497.797665:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509497.797667:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.797673:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f200/0xe5156b86310de851 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2f44a232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.797768:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:12478:x1875387774768256:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 764us (1014us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788509497.797776:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:3.0:1788509497.800008:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.800109:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774768384 00000100:00100000:2.0:1788509497.800122:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774768384 00000100:00100000:2.0:1788509497.800193:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:2.0:1788509497.800204:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+67:12478:x1875387774768384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509497.800230:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509497.800261:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de858 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533f2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.800307:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.800323:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.800336:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.800508:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3c00/0xe5156b86310de858 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.800529:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.800538:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509497.800541:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788509497.800545:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2000, rc 0) 00000100:00100000:2.0:1788509497.800620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+68:12478:x1875387774768384:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 417us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.800628:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:3.0:1788509497.803729:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.807118:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774768640 00000100:00100000:1.0:1788509497.807141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774768640 00000100:00100000:1.0:1788509497.807549:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:1.0:1788509497.807563:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+68:12478:x1875387774768640:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788509497.807803:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.807827:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.807843:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788509497.808079:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:1.0:1788509497.808145:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000beb577dc reply state 000000000431835f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.808161:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.808169:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:1.0:1788509497.808408:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788509497.808415:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788509497.808571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+70:12478:x1875387774768640:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1009us (4852us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788509497.808580:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:3.0:1788509497.812121:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.812523:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774768768 00000100:00100000:2.0:1788509497.812537:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774768768 00000100:00100000:2.0:1788509497.812619:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:2.0:1788509497.812632:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+70:12478:x1875387774768768:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509497.812675:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509497.812704:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475533f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.813494:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.813514:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.813558:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509497.813561:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509497.813566:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3a00, rc 0) 00000100:00100000:2.0:1788509497.813658:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+71:12478:x1875387774768768:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1028us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.813668:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:3.0:1788509497.818183:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.818579:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774768896 00000100:00100000:0.0:1788509497.818593:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774768896 00000100:00100000:0.0:1788509497.818705:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1788509497.818718:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2407:x1875387774768896:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788509497.819062:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2407:x1875387774768896:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 346us (894us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788509497.819072:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1788509497.821754:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.821854:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774769152 00000100:00100000:1.0:1788509497.821866:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774769152 00000100:00100000:1.0:1788509497.821979:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1788509497.821991:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+71:12478:x1875387774769152:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788509497.822269:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+72:12478:x1875387774769152:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 279us (527us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788509497.822277:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1788509497.824865:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.825121:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774769408 00000100:00100000:0.0:1788509497.825152:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774769408 00000100:00100000:0.0:1788509497.825225:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:0.0:1788509497.825237:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+72:12478:x1875387774769408:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788509497.825593:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+72:12478:x1875387774769408:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 356us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.825603:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:3.0:1788509497.827686:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.828044:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774769536 00000100:00100000:0.0:1788509497.828057:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774769536 00000100:00100000:0.0:1788509497.828179:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:0.0:1788509497.828192:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+72:12478:x1875387774769536:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788509497.828219:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.828249:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de874 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553400 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.828351:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de87b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.828372:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de87b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.828387:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de87b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509497.828459:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509497.828484:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de87b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.828530:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310de874 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553400 expref: 74 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.828581:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de87b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553400 expref: 73 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.828592:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:0.0:1788509497.828596:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788509497.828600:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846e000, rc 0) 00000100:00100000:0.0:1788509497.828669:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+73:12478:x1875387774769536:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 479us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.828676:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:3.0:1788509497.831122:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.831248:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774769664 00000100:00100000:1.0:1788509497.831259:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774769664 00000100:00100000:1.0:1788509497.831335:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1788509497.831357:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+10:2408:x1875387774769664:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509497.831381:0:8756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509497.831405:0:8756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553407 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788509497.831446:0:8756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a7d39, blocks: 0x0 00010000:00010000:1.0:1788509497.831472:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=394s v=(0 0) 00010000:00010000:1.0:1788509497.831478:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509497.831489:0:8756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 11 pid: 8756 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.831513:0:8756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 11 pid: 8756 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.831529:0:8756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae200, rc 0) 00000100:00100000:1.0:1788509497.831595:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:2408:x1875387774769664:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 241us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.831621:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1788509497.834895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.835229:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774769920 00000100:00100000:3.0:1788509497.835241:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774769920 00000100:00100000:3.0:1788509497.835315:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:3.0:1788509497.835328:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+73:12478:x1875387774769920:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788509497.835491:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+73:12478:x1875387774769920:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 165us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.835518:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:3.0:1788509497.840112:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.840236:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774770048 00000100:00100000:0.0:1788509497.840249:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774770048 00000100:00100000:0.0:1788509497.840327:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:0.0:1788509497.840658:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:12478:x1875387774770048:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788509497.840685:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509497.840710:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755340e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.840756:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 12 pid: 8756 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.840766:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788509497.840783:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509497.840790:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.840861:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 12 pid: 8756 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.840880:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 12 pid: 8756 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.840936:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1875387796833280:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509497.841092:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d42480 going to sleep for 11 seconds 00000100:00100000:3.0:1788509497.844663:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.844752:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774770176 00000100:00100000:1.0:1788509497.844765:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774770176 00010000:00010000:1.0:1788509497.844827:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 13 pid: 8756 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.844879:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:1.0:1788509497.844891:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:2408:x1875387774770176:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509497.844945:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509497.844975:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 13 pid: 8756 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.844993:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 13 pid: 8756 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.845026:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509497.845032:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509497.845043:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 13 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.845056:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 13 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.845105:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 13 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.845145:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1875387796833408:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788509497.846040:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000773180b3/0xe5156b86310de882 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553407 expref: 13 pid: 8756 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.846061:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1875387796833280:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509497.846093:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.846106:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846ec00, rc 0) 00000100:00100000:0.0:1788509497.846157:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:12478:x1875387774770048:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 5819us (6059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.846167:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788509497.851422:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.852084:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509497.852134:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1875387796833408:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788509497.852169:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509497.852246:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:2408:x1875387774770176:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 7355us (7595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.852258:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:2.0:1788509497.853297:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774770304 00000100:00100000:2.0:1788509497.853311:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774770304 00002000:00100000:2.0:1788509497.853394:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8bcc876adc00 x1875387774770304/t0(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:578/0 lens 504/0 e 0 to 0 dl 1788509508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788509497.853406:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc876adc00 with x1875387774770304 ext(0->12) 00002000:00010000:2.0:1788509497.853412:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcc876adc00 00000100:00100000:2.0:1788509497.853462:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788509497.853474:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+11:2407:x1875387774770304:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788509497.854999:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:2407:x1875387774770304:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 1515us (3580us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788509497.855013:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00002000:00100000:2.0:1788509497.855026:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8bcc876adc00 x1875387774770304/t4294967321(0) o4->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:578/0 lens 504/448 e 0 to 0 dl 1788509508 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788509497.855037:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc876adc00 with x1875387774770304 ext(0->12) 00002000:00010000:2.0:1788509497.855044:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcc876adc00 00000100:00100000:0.0:1788509497.858196:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.858298:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774770432 00000100:00100000:2.0:1788509497.858310:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774770432 00000100:00100000:2.0:1788509497.858509:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:2.0:1788509497.858522:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+73:12478:x1875387774770432:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788509497.860676:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788509497.860728:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:2.0:1788509497.860814:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.860828:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.860838:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.860844:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.860849:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.860858:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.860882:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8bcc8761ec00) 00010000:00010000:2.0:1788509497.860886:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509497.860892:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.860985:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af000/0xe5156b86310de58e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861026:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861034:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861060:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861066:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.861069:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861077:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861085:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bcc865bc300) 00010000:00010000:2.0:1788509497.861088:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509497.861092:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861098:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310de636 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861118:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861126:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861132:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861137:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afa00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.861141:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861155:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861164:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ef00) 00010000:00010000:2.0:1788509497.861166:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509497.861169:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861175:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862afa00/0xe5156b86310de6b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861188:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861195:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861200:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861204:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.861207:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861213:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861220:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcc8761ef00) 00010000:00010000:2.0:1788509497.861223:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509497.861226:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861237:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de6d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861257:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861263:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861269:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861274:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.861277:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861283:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861292:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509497.861294:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509497.861298:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861303:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de7a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861352:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861360:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861375:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861379:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.861382:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861388:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861396:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509497.861399:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788509497.861402:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.861408:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310de866 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.861714:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509497.861738:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796833536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788509497.861834:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.861948:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796833536 00000100:00100000:0.0:1788509497.861957:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796833536 00000100:00100000:0.0:1788509497.862013:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788509497.862024:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796833536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788509497.862058:0:8756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1788509497.862099:0:8756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9a7d38, atime: 0x6a9a7d38, ctime: 0x6a9a7d38, blocks: 0x8 00010000:00010000:0.0:1788509497.862107:0:8756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.862125:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1788509497.862130:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509497.862138:0:8756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.862156:0:8756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.862167:0:8756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.862175:0:8756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.862192:0:8756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788509497.862365:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796833536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 342us (530us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788509497.862374:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1788509497.862443:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcc87dfc380/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788509497.862450:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796833536:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788509497.862649:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509497.862657:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.862666:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846fc00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509497.862671:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.862680:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.862710:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.862719:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3fe0abe/0xe5156b86310de890 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.862740:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509497.862742:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509497.862744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788509497.863169:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bcdb5a4a840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788509497.863175:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcd8a5ad800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bcdb5a4ab40 00000020:00080000:3.0:1788509497.863179:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcd8a5ad300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bcc8738b800 00000004:00080000:3.0:1788509497.863219:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788509497.863255:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bcd83748240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788509497.863258:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcd8338e600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bcd83748a80 00000020:00080000:3.0:1788509497.863261:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcd8338e800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bcd8a222a00 00000100:00100000:3.0:1788509497.863445:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12478:x1875387774770432:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 4911us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.863455:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:1.0:1788509497.864491:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509497.864512:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796833664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788509497.864583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509497.864645:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796833664 00000100:00100000:1.0:1788509497.864653:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796833664 00000100:00100000:1.0:1788509497.864707:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788509497.864717:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796833664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788509497.864750:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1788509497.864980:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.865007:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.865017:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788509497.865022:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509497.865028:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.865077:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.865093:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 12 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.865106:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796833792:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509497.865171:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509497.868055:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796833792:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509497.868099:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788509497.868789:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788509497.868932:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788509497.870350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.870394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.870819:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774770688 00000100:00100000:3.0:1788509497.870832:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774770688 00010000:00010000:3.0:1788509497.870927:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 13 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.870979:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:3.0:1788509497.870994:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+13:2407:x1875387774770688:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509497.871012:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509497.871035:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 13 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.871052:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 13 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.871082:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310de644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553366 expref: 13 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.871104:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509497.871109:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509497.871116:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.871129:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.871161:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509497.871232:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:2407:x1875387774770688:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 240us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.871241:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:1.0:1788509497.872566:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774770560 00000100:00100000:1.0:1788509497.872582:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774770560 00000100:00100000:1.0:1788509497.872660:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788509497.872672:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+12:2408:x1875387774770560:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788509497.872772:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.872799:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.872811:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.872835:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.874196:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788509497.874524:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875387796833664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9803us (9935us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788509497.874536:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1788509497.874636:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcdb787ce00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788509497.874652:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796833664:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788509497.875192:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509497.875204:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.875220:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509497.875225:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.875239:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.875263:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.875284:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000210e681/0xe5156b86310de897 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.875312:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509497.875314:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509497.875316:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788509497.879732:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1788509497.879752:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788509497.880165:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774770560:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 7488us (9827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.880180:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1788509497.891685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.892045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774770944 00000100:00100000:3.0:1788509497.892058:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774770944 00000100:00100000:3.0:1788509497.892139:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:3.0:1788509497.892151:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12478:x1875387774770944:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788509497.892248:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509497.892285:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e000/0xe5156b86310de87b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553400 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.892310:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:3.0:1788509497.892316:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509497.892372:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.892390:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.892402:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788509497.892571:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fdd8be8 reply state 00000000f0ea8c5a transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.892585:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.892593:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:3.0:1788509497.892596:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788509497.892599:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788509497.892743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:12478:x1875387774770944:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 593us (1071us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1788509497.892751:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:2.0:1788509497.895486:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.895631:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774771072 00000100:00100000:1.0:1788509497.895643:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774771072 00000100:00100000:1.0:1788509497.895712:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788509497.895723:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2410:x1875387774771072:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788509497.895967:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788509497.895972:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788509496 00002000:00010000:1.0:1788509497.895974:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788509496 00002000:00010000:1.0:1788509497.895977:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788509497 -> 1788509496 00002000:00010000:1.0:1788509497.895979:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788509497.896053:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2410:x1875387774771072:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 331us (580us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788509497.896061:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788509497.899087:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509497.899194:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774771328 00000100:00100000:2.0:1788509497.899208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774771328 00000100:00100000:2.0:1788509497.899282:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:2.0:1788509497.899295:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:12478:x1875387774771328:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788509497.899402:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.899423:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.899446:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.899492:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.899511:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 22 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.899551:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88424000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796833920:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509497.899650:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788509497.907818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.908486:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774771456 00000100:00100000:3.0:1788509497.908501:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774771456 00010000:00010000:3.0:1788509497.908557:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 23 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.908626:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:3.0:1788509497.908636:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:2408:x1875387774771456:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509497.908656:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509497.908664:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 23 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.908679:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 23 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.908706:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:3.0:1788509497.908712:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.908724:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.908733:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.908758:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509497.908836:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+23:2408:x1875387774771456:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 201us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.908844:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00010000:00010000:0.0:1788509497.910503:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de85f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f2 expref: 22 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.910532:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88424000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875387796833920:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509497.910562:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.910664:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.910672:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.910727:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.910736:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.910744:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.910751:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509497.910756:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.910830:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.911039:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:2.0:1788509497.911044:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788509497.911050:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.911083:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.911296:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12478:x1875387774771328:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 12000us (12219us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788509497.911307:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:2.0:1788509497.914722:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.914891:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774771584 00000100:00100000:1.0:1788509497.915041:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774771584 00000100:00100000:1.0:1788509497.915141:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1788509497.915153:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774771584:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788509497.915284:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.915309:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.915318:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509497.915323:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788509497.915328:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.915456:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509497.915473:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 8 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509497.915490:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796834048:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509497.915628:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788509497.919702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.919791:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774771712 00000100:00100000:3.0:1788509497.919803:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774771712 00010000:00010000:3.0:1788509497.919867:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 9 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.919968:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:3.0:1788509497.919979:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774771712:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509497.919999:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509497.920027:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 9 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.920043:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 9 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.920074:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509497.920078:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509497.920086:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.920097:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.920122:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509497.920200:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+9:2408:x1875387774771712:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 222us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.920208:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00010000:00010000:2.0:1788509497.921730:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f69e4d6/0xe5156b86310de889 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e464755340e expref: 8 pid: 8438 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.921758:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875387796834048:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509497.921968:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.921982:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.921990:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.922025:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.922035:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.922068:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.922076:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509497.922082:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.922091:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.922114:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.922121:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d29bf9b/0xe5156b86310de8ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.922497:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774771584:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 7342us (7785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509497.922510:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1788509497.927446:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.929690:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774771968 00000100:00100000:0.0:1788509497.929711:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774771968 00000100:00100000:0.0:1788509497.930483:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:0.0:1788509497.930501:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:12478:x1875387774771968:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788509497.930619:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.930643:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.930654:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.930702:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.930719:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 21 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.930761:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796834176:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509497.930892:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d42600 going to sleep for 11 seconds 00000100:00100000:1.0:1788509497.938017:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.938497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774772096 00000100:00100000:3.0:1788509497.938510:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774772096 00010000:00010000:3.0:1788509497.938564:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 22 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.938785:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:3.0:1788509497.938797:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89173450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:2408:x1875387774772096:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509497.938817:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509497.938824:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 22 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.938840:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 22 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.938883:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:3.0:1788509497.938891:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.939023:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.939032:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.939042:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.939068:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509497.939298:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89173450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:2408:x1875387774772096:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 502us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.939306:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00010000:00010000:0.0:1788509497.939594:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846fa00/0xe5156b86310de7a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533ba expref: 21 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.939616:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796834176:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509497.939639:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.939650:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.939656:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.940022:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.940038:0:9006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.940048:0:9006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.940086:0:9006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.940104:0:9006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 21 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.940134:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796834304:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509497.940509:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d42c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788509497.947951:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509497.948386:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774772224 00000100:00100000:3.0:1788509497.948416:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774772224 00010000:00010000:3.0:1788509497.948481:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 22 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509497.948543:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:3.0:1788509497.948554:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:2407:x1875387774772224:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509497.948572:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509497.948589:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 22 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.948607:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 22 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.948635:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:3.0:1788509497.948642:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.948652:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.948661:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.948685:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509497.948749:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:2407:x1875387774772224:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 196us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509497.948757:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00010000:00010000:2.0:1788509497.949394:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3a00/0xe5156b86310de86d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533f9 expref: 21 pid: 6521 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509497.949416:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796834304:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509497.949451:0:9006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.949475:0:9006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509497.949482:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788509497.949637:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788509497.950054:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788509497.950101:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788509497.950271:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88426a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9006:1875387796834432:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788509497.950503:0:9006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509497.950594:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509497.952682:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796834432 00000100:00100000:1.0:1788509497.952700:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796834432 00000100:00100000:1.0:1788509497.952891:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788509497.952920:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9006:x1875387796834432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788509497.953091:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9006:x1875387796834432:12345-0@lo:1000:mdt00_003.0 Request processed in 174us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.953100:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788509497.953214:0:9006:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1788509497.953222:0:9006:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1788509497.953249:0:9006:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcdb787ce00, transno 4294967322 00000100:00100000:0.0:1788509497.953275:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88426a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9006:1875387796834432:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788509497.953477:0:9006:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788509497.953567:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9006:1875387796834560:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788509497.953629:0:9006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509497.954366:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d42d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509497.954524:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796834560 00000100:00100000:2.0:1788509497.954532:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796834560 00000100:00100000:2.0:1788509497.954594:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788509497.954603:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9006:x1875387796834560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788509497.955049:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9006:x1875387796834560:12345-0@lo:1000:mdt00_003.0 Request processed in 446us (1419us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788509497.955058:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788509497.955171:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9006:1875387796834560:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788509497.955241:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955252:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955259:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955266:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.955271:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955279:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955322:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:0.0:1788509497.955325:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788509497.955331:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955471:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f400/0xe5156b86310de8ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955510:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955518:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955524:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955529:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509497.955532:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955539:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955549:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:0.0:1788509497.955551:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788509497.955559:0:9006:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955573:0:9006:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955603:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.955649:0:9006:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509497.955664:0:9006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796834688:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788509497.956010:0:9006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87d42d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509497.960384:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509497.960576:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774772352 00000100:00100000:1.0:1788509497.960597:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774772352 00000100:00100000:1.0:1788509497.960671:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788509497.960687:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12477:x1875387774772352:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:1.0:1788509497.960870:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12477:x1875387774772352:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 187us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509497.960878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788509497.961753:0:9006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9006:1875387796834688:192.168.203.12@tcp:105: 00010000:00010000:3.0:1788509497.962555:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962848:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310de7fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962924:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962942:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962956:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962967:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962974:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962980:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962986:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509497.962991:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.962999:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963010:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:3.0:1788509497.963013:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788509497.963017:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963034:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310de8c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963047:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963053:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963060:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963066:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509497.963071:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963077:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963086:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:3.0:1788509497.963088:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788509497.963091:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.963096:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de8b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788509497.964688:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788509497.964699:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788509497.965018:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:12478:x1875387774771968:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 34516us (38575us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788509497.965032:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 247 00000020:00080000:3.0:1788509497.965053:0:9006:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788509497.965783:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788509497.965798:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788509497.967551:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509497.970208:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774772608 00000100:00100000:0.0:1788509497.970222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774772608 00000100:00100000:0.0:1788509497.970296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:0.0:1788509497.970305:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:12477:x1875387774772608:12345-192.168.203.12@tcp:58:lfs.0 00000100:00100000:2.0:1788509497.970405:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000040:00080000:0.0:1788509497.970494:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788509497.970567:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774772864 00000100:00100000:3.0:1788509497.970578:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774772864 00000100:00100000:0.0:1788509497.970596:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+25:12477:x1875387774772608:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 288us (3054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509497.970606:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:3.0:1788509497.970647:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788509497.970658:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+24:12478:x1875387774772864:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788509497.970993:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788509497.971038:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788509497.971082:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.971102:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.971117:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.971127:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.971134:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.971141:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509497.971161:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788509497.971513:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+26:12478:x1875387774772864:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 854us (1115us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788509497.971523:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000020:00080000:3.0:1788509497.971528:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788509497.972355:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509497.972369:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.972389:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509497.972394:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.972405:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.972453:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:0.0:1788509497.972456:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788509497.972461:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.972468:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de8c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509497.972485:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509497.972487:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509497.972488:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509498.018421:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509498.018702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774772992 00000100:00100000:3.0:1788509498.018735:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774772992 00000100:00100000:3.0:1788509498.018863:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:3.0:1788509498.018876:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+26:12480:x1875387774772992:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509498.018948:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509498.018976:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de8cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553415 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509498.019060:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509498.019079:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509498.019093:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509498.019112:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509498.019118:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509498.019125:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788509498.019483:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788509498.024683:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.024719:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 27 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.024731:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.025276:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 27 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.025318:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 27 pid: 9006 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509498.025477:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796834816:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509498.026306:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509498.034497:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875387796834816:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509498.034540:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509498.035527:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509498.035861:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774773248 00000100:00100000:3.0:1788509498.035874:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774773248 00000100:00100000:3.0:1788509498.035999:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788509498.036011:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+28:6179:x1875387774773248:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788509498.037512:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:6179:x1875387774773248:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 1492us (1981us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788509498.037670:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788509498.042464:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509498.042697:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774773376 00000100:00100000:1.0:1788509498.042711:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774773376 00010000:00010000:1.0:1788509498.042768:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 29 pid: 9006 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509498.042832:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1788509498.042845:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:2408:x1875387774773376:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509498.042864:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509498.042872:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 29 pid: 9006 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.042888:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 29 pid: 9006 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.042960:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3000/0xe5156b86310de7ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475533d6 expref: 29 pid: 9006 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.043004:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509498.043011:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.043022:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.043032:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509498.043073:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509498.043150:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+28:2408:x1875387774773376:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 308us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509498.043159:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00010000:00010000:2.0:1788509498.044383:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044423:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509498.044502:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788509498.044508:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509498.044532:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044551:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044563:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044571:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044579:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044596:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8e00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509498.044600:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044610:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044626:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:2.0:1788509498.044630:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509498.044635:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044653:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8e00/0xe5156b86310de8d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044670:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044676:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044682:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044686:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509498.044689:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044696:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044704:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8bcd8a893f00) 00010000:00010000:2.0:1788509498.044707:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509498.044709:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044715:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de8dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044764:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de8cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553415 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044796:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553415 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509498.044812:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509498.044814:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509498.044816:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af200, rc 0) 00000100:00100000:2.0:1788509498.044946:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12480:x1875387774772992:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 26025us (26494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509498.044955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:2.0:1788509498.070836:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796834944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509498.070951:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509498.071021:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796834944 00000100:00100000:2.0:1788509498.071031:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796834944 00000100:00100000:2.0:1788509498.071093:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788509498.071105:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796834944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788509498.071135:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788509498.071207:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796834944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509498.071214:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788509498.071275:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796834944:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788509498.072495:0:8755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395233594940ns, next at 396233590954ns, rc = 0 00000100:00100000:2.0:1788509498.072570:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788509498.072594:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796835072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509498.072650:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509498.072811:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796835072 00000100:00100000:3.0:1788509498.072819:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796835072 00000100:00100000:3.0:1788509498.072872:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788509498.072881:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796835072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509498.072918:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788509498.072976:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796835072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509498.072983:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788509498.073327:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796835072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788509498.263129:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509498.647113:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509498.647565:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509498.647607:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509498.647633:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509498.647661:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509498.647696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774773632 00000100:00100000:3.0:1788509498.647709:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774773632 00000100:00100000:3.0:1788509498.648918:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774773888 00000100:00100000:3.0:1788509498.648927:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774773888 00000100:00100000:1.0:1788509498.648980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774774016 00000100:00100000:1.0:1788509498.648984:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774774016 00000100:00100000:1.0:1788509498.649026:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 332 00000100:00100000:1.0:1788509498.649038:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774773632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509498.649058:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 333 00000100:00100000:3.0:1788509498.649065:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774774016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509498.649207:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774774016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 141us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509498.649216:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 333 00000100:00100000:3.0:1788509498.649255:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 334 00000100:00100000:3.0:1788509498.649262:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774773888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509498.649368:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2410:x1875387774773888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 106us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509498.649375:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 334 00000100:00100000:3.0:1788509498.649401:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774773504 00000100:00100000:3.0:1788509498.649405:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774773504 00000100:00100000:3.0:1788509498.649555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 389 00000100:00100000:3.0:1788509498.649563:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774773504:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509498.649591:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2410:x1875387774773504:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509498.649598:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 389 00000100:00100000:3.0:1788509498.649632:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774773760 00000100:00100000:3.0:1788509498.649637:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774773760 00000100:00100000:3.0:1788509498.649669:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:3.0:1788509498.649675:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774773760:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509498.649702:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774773760:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509498.649708:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00080000:3.0:1788509498.649923:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509498.649928:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509498.652069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2410:x1875387774773632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3016us (4953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509498.652087:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 332 00000040:00080000:3.0:1788509498.994477:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788509498.994490:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788509498.994548:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788509498.994560:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788509498.994954:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796835200:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788509498.995091:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509498.997544:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875387796835200:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788509498.998571:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509498.999462:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774774144 00000100:00100000:0.0:1788509498.999475:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774774144 00000100:00100000:0.0:1788509498.999559:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 250 00000100:00100000:0.0:1788509498.999580:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12491:x1875387774774144:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788509498.999626:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788509499.000514:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12491:x1875387774774144:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 939us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509499.000525:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 250 00000100:00100000:0.0:1788509499.008066:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509499.008172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774774400 00000100:00100000:2.0:1788509499.008186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774774400 00000100:00100000:2.0:1788509499.008276:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:2.0:1788509499.008289:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+27:12491:x1875387774774400:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509499.008328:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509499.008371:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755341c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509499.008517:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de8f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509499.008536:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509499.008553:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509499.008567:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788509499.008713:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2600/0xe5156b86310de8eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755341c expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509499.008733:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755341c expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509499.008743:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:2.0:1788509499.008747:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509499.008752:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2000, rc 0) 00000100:00100000:2.0:1788509499.008829:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:12491:x1875387774774400:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 543us (773us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788509499.008836:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:1.0:1788509499.018715:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509499.018821:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774774528 00000100:00100000:3.0:1788509499.018833:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774774528 00000100:00100000:1.0:1788509499.018851:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509499.018930:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788509499.018945:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:2410:x1875387774774528:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788509499.018964:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509499.018996:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce2000/0xe5156b86310de8f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755341c expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509499.019017:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509499.019024:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509499.019043:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774774784 00000100:00100000:0.0:1788509499.019048:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774774784 00000100:00100000:0.0:1788509499.019166:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 252 00000100:00100000:0.0:1788509499.019175:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:12491:x1875387774774784:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788509499.019261:0:9006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509499.019291:0:9006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509499.019303:0:9006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509499.019452:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:2410:x1875387774774528:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 511us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509499.019460:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00010000:00010000:0.0:1788509499.019509:0:9006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509499.019519:0:9006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509499.019526:0:9006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509499.019532:0:9006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509499.019538:0:9006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509499.019546:0:9006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509499.019556:0:9006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:0.0:1788509499.019560:0:9006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788509499.019564:0:9006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509499.019645:0:9006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f600/0xe5156b86310de900 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509499.019808:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:12491:x1875387774774784:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 634us (955us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788509499.019821:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 252 00000040:00080000:1.0:1788509499.019977:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788509499.019983:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788509499.020988:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788509499.021006:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788509499.029924:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509499.030342:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774775040 00000100:00100000:2.0:1788509499.030355:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774775040 00000100:00100000:2.0:1788509499.030441:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1788509499.030462:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+29:12491:x1875387774775040:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788509499.030750:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:12491:x1875387774775040:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 290us (852us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788509499.030758:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000040:00080000:0.0:1788509499.095233:0:14759:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509499.095245:0:14759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509499.095289:0:14759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788509499.095305:0:14759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788509499.290958:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509499.302581:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509499.302682:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774775296 00000100:00100000:3.0:1788509499.302696:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774775296 00000100:00100000:3.0:1788509499.302779:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:3.0:1788509499.302792:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+30:12504:x1875387774775296:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509499.302824:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509499.302853:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de907 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553423 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.303815:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de90e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.303839:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de90e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.303855:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de90e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509499.303871:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788509499.304216:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d8400/0xe5156b86310de907 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553423 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.304236:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de90e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553423 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.304247:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:3.0:1788509499.304250:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788509499.304255:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9200, rc 0) 00000100:00100000:3.0:1788509499.304466:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:12504:x1875387774775296:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1676us (1908us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788509499.304477:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:2.0:1788509499.324028:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509499.324209:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774775424 00000100:00100000:3.0:1788509499.324222:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774775424 00000100:00100000:3.0:1788509499.324419:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:3.0:1788509499.324441:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:12504:x1875387774775424:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788509499.324539:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324562:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324578:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324626:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324634:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324642:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324648:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:3.0:1788509499.324654:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324662:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324692:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:3.0:1788509499.324695:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788509499.324702:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509499.324710:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9000/0xe5156b86310de91c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509499.324812:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+32:12504:x1875387774775424:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 373us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509499.324821:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:2.0:1788509499.473662:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509499.473849:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774775552 00000100:00100000:0.0:1788509499.473863:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774775552 00000100:00080000:3.0:1788509499.473997:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509499.474546:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1788509499.474563:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774775552:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788509499.474586:0:8756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509499.474614:0:8756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094d32a1b/0xe5156b86310de923 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755342a expref: -99 pid: 8756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509499.474647:0:8756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9a7d38, atime: 0x6a9a7d38, ctime: 0x6a9a7d38, blocks: 0x8 00010000:00010000:2.0:1788509499.474675:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1788509499.474680:0:8756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509499.474692:0:8756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094d32a1b/0xe5156b86310de923 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755342a expref: 8 pid: 8756 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509499.474715:0:8756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094d32a1b/0xe5156b86310de923 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755342a expref: 8 pid: 8756 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509499.474732:0:8756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3c00, rc 0) 00000100:00100000:2.0:1788509499.476011:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2408:x1875387774775552:12345-192.168.203.12@tcp:101:cat.0 Request processed in 1192us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509499.476026:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1788509499.481699:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509499.482242:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774775680 00000100:00100000:1.0:1788509499.482257:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774775680 00002000:00100000:1.0:1788509499.482335:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8bcc88426a00 x1875387774775680/t0(0) o3->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:580/0 lens 488/0 e 0 to 0 dl 1788509510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509499.482348:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc88426a00 with x1875387774775680 ext(0->4095) 00002000:00010000:1.0:1788509499.482355:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcc88426a00 00000100:00100000:1.0:1788509499.482400:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788509499.482411:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774775680:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:1.0:1788509499.482743:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+8:2407:x1875387774775680:12345-192.168.203.12@tcp:3:cat.0 Request processed in 332us (1058us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788509499.482760:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00002000:00100000:1.0:1788509499.482768:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8bcc88426a00 x1875387774775680/t0(0) o3->d1c7a223-cc58-4f2c-be22-e37eba96eeae@192.168.203.12@tcp:580/0 lens 488/4536 e 0 to 0 dl 1788509510 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788509499.482777:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bcc88426a00 with x1875387774775680 ext(0->4095) 00002000:00010000:1.0:1788509499.482781:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bcc88426a00 00000040:00080000:1.0:1788509500.054181:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788509500.054195:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788509500.054224:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788509500.054235:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788509500.311008:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509500.759713:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788509501.337052:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509502.166577:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796835328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509502.166696:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509502.167020:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796835328 00000100:00100000:1.0:1788509502.167034:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796835328 00000100:00100000:1.0:1788509502.167113:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788509502.167124:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796835328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509502.167175:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509502.167240:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796835328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509502.167247:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788509502.169258:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796835328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509502.360688:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509502.684147:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509502.684178:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796835456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509502.684268:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509502.684349:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796835456 00000100:00100000:3.0:1788509502.684358:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796835456 00000100:00100000:3.0:1788509502.684441:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788509502.684454:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796835456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509502.684682:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509502.684695:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796835584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509502.685090:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509502.685129:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796835584 00000100:00100000:0.0:1788509502.685134:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796835584 00000100:00100000:0.0:1788509502.685166:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788509502.685172:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796835584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509502.685207:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788509502.685258:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796835584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509502.685266:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788509502.685320:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796835584:0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1788509502.685894:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509502.686084:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796835456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1632us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509502.686094:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1788509502.686121:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509502.686244:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796835712:0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.686283:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509502.686310:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796836224:0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.686344:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509502.686364:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796836736:0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.686384:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509502.686423:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788509502.686430:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796836096:0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.686451:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509502.688145:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796836608:0@lo:400:kworker.0 00000100:00100000:2.0:1788509502.688180:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796835968:0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.689035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796836224 00000100:00100000:0.0:1788509502.689048:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796836224 00000100:00100000:0.0:1788509502.689129:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796836736 00000100:00100000:0.0:1788509502.689133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796836736 00000100:00100000:0.0:1788509502.689150:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796836096 00000100:00100000:0.0:1788509502.689165:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796836096 00000100:00100000:0.0:1788509502.689193:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788509502.689204:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796836224:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788509502.691974:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509502.691988:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509502.692273:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509502.692332:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796836480:0@lo:400:kworker.0 00000100:00100000:2.0:1788509502.692390:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509502.693214:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796836992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509502.693314:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796835968 00000100:00100000:1.0:1788509502.693327:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796835968 00000100:00100000:1.0:1788509502.693393:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788509502.693417:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796836736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.695310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509502.695437:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796836480 00000100:00100000:3.0:1788509502.695448:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796836480 00000100:00100000:3.0:1788509502.695593:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788509502.695605:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796836480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.696137:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796836480:12345-0@lo:400:kworker.0 Request processed in 533us (3743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509502.696145:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788509502.696253:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509502.697084:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509502.697296:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796836992 00000100:00100000:3.0:1788509502.697306:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796836992 00000100:00100000:3.0:1788509502.697591:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788509502.697601:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796836992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788509502.697638:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509502.697763:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796836480:0@lo:400:kworker.0 00000100:00100000:2.0:1788509502.697785:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788509502.697800:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796835840:0@lo:400:kworker.0 00000100:00100000:2.0:1788509502.698128:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509502.698149:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796836352:0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.698281:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796836992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 682us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509502.698290:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788509502.698321:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788509502.699156:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509502.699331:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796836864:0@lo:400:kworker.0 00000100:00100000:2.0:1788509502.699386:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509502.699592:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796836352 00000100:00100000:2.0:1788509502.699932:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796836992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509502.700020:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796836224:12345-0@lo:400:kworker.0 Request processed in 10813us (13669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509502.700037:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788509502.700043:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796836352 00000100:00100000:0.0:1788509502.700076:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796836608 00000100:00100000:0.0:1788509502.700082:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796836608 00000100:00100000:3.0:1788509502.700107:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796836864 00000100:00100000:3.0:1788509502.700112:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796836864 00000100:00100000:3.0:1788509502.700134:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788509502.700143:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796836352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.700244:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796835840 00000100:00100000:0.0:1788509502.700248:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796835840 00000100:00100000:0.0:1788509502.700269:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788509502.700278:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796836096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509502.700321:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796835456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509502.700574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796836096:12345-0@lo:400:kworker.0 Request processed in 297us (14120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509502.700582:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788509502.700598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788509502.700608:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796835968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.700652:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796835968:12345-0@lo:400:kworker.0 Request processed in 47us (8385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509502.700659:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788509502.700690:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788509502.700696:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796836608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.700724:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796836608:12345-0@lo:400:kworker.0 Request processed in 29us (5423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509502.700730:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788509502.700814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788509502.700821:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796835840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.700972:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796835840:12345-0@lo:400:kworker.0 Request processed in 152us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509502.700979:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788509502.701004:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796835712 00000100:00100000:0.0:1788509502.701009:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796835712 00000100:00100000:0.0:1788509502.701041:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788509502.701047:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796835712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.701166:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796836352:12345-0@lo:400:kworker.0 Request processed in 953us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509502.701485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796835712:12345-0@lo:400:kworker.0 Request processed in 437us (15201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509502.701493:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788509502.701560:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788509502.701584:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788509502.701594:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796836864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.701661:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796835840:0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.701678:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796836352:0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.701691:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796836864:0@lo:400:kworker.0 00000100:00100000:0.0:1788509502.701704:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796835968:0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.701785:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796836864:12345-0@lo:400:kworker.0 Request processed in 73us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509502.701792:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1788509502.702283:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509502.702291:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509502.702328:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796836096:0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.702346:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796836608:0@lo:400:kworker.0 00000100:00100000:3.0:1788509502.702356:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796835712:0@lo:400:kworker.0 00010000:00080000:3.0:1788509502.702373:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876aea00 x1875387796836224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509502.702383:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796836224:0@lo:400:kworker.0 00000100:00100000:1.0:1788509502.705379:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796836736:12345-0@lo:400:kworker.0 Request processed in 11952us (18978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509502.705431:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00080000:3.0:1788509502.705619:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913e5880 x1875387796836736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509502.705638:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796836736:0@lo:400:kworker.0 00000001:00080000:1.0:1788509502.710250:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1788509503.190452:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509503.190482:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796837120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509503.190580:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509503.190673:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796837120 00000100:00100000:0.0:1788509503.190683:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796837120 00000100:00100000:0.0:1788509503.190744:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788509503.190754:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796837120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509503.190793:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788509503.190844:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796837120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509503.190872:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788509503.190952:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796837120:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788509503.191693:0:8755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400352792470ns, next at 401352789126ns, rc = 0 00000100:00100000:1.0:1788509503.192143:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509503.192162:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796837248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788509503.192224:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509503.192428:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796837248 00000100:00100000:3.0:1788509503.192436:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796837248 00000100:00100000:3.0:1788509503.192570:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788509503.192591:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796837248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509503.192615:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788509503.192676:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875387796837248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509503.192684:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788509503.192758:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796837248:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788509503.201267:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:0.0:1788509503.201323:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:0.0:1788509503.201343:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1788509503.201359:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bcc87d42780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788509503.201365:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcd92717400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bcc87d426c0 00000020:00080000:0.0:1788509503.201368:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bcd92717100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bcd8c777600 00000020:00080000:0.0:1788509503.201404:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1788509503.201446:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509503.201461:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509503.201469:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509503.201476:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509503.201482:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509503.201491:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509503.201516:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8bcdbd047a00) 00010000:00010000:1.0:1788509503.201520:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509503.201526:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509503.201533:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030800/0xe5156b86310de89e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788509503.201588:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788509503.201708:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788509503.202377:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509503.202411:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796837376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788509503.202514:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509503.202647:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796837376 00000100:00100000:3.0:1788509503.202661:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796837376 00000100:00100000:3.0:1788509503.202733:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788509503.202744:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796837376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788509503.202952:0:8756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788509503.202956:0:8756:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788509496 -> 1788509496 00002000:00010000:3.0:1788509503.202959:0:8756:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1788509496 -> 1788509496 00002000:00010000:3.0:1788509503.202961:0:8756:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788509496 -> 1788509496 00002000:00010000:3.0:1788509503.202964:0:8756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788509503.203015:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796837376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 272us (501us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788509503.203023:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:1.0:1788509503.203477:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcd913e5880/2, rc 0, transno 4294967325 00000100:00100000:1.0:1788509503.203485:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796837376:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788509503.204873:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1788509503.204981:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:0.0:1788509503.382244:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509503.773802:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509503.773885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509503.774050:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774776064 00000100:00100000:0.0:1788509503.774064:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774776064 00000100:00100000:0.0:1788509503.774168:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 341 00000100:00100000:0.0:1788509503.774180:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774776064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509503.774275:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774776064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 98us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509503.774284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 341 00000100:00080000:2.0:1788509503.774381:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509503.774647:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774775808 00000100:00100000:3.0:1788509503.774653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774775808 00000100:00100000:3.0:1788509503.774696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 391 00000100:00100000:3.0:1788509503.774704:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774775808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509503.774767:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774775808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 63us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509503.774774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 391 00000100:00100000:2.0:1788509503.784963:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509503.785028:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509503.785047:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509503.785080:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509503.785127:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774776320 00000100:00100000:2.0:1788509503.785140:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774776320 00000100:00100000:2.0:1788509503.785218:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774776192 00000100:00100000:2.0:1788509503.785222:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774776192 00000100:00100000:2.0:1788509503.785252:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:2.0:1788509503.785262:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774776320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509503.785455:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:3.0:1788509503.785467:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774776192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509503.785546:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2408:x1875387774776192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509503.785555:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:2.0:1788509503.785762:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2408:x1875387774776320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 500us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509503.785769:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00080000:2.0:1788509503.785794:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509503.785799:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788509503.785863:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509503.786172:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774776576 00000100:00100000:3.0:1788509503.786177:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774776576 00000100:00100000:3.0:1788509503.786226:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774775936 00000100:00100000:3.0:1788509503.786229:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774775936 00000100:00100000:3.0:1788509503.786244:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774776448 00000100:00100000:3.0:1788509503.786247:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774776448 00000100:00100000:3.0:1788509503.786263:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 342 00000100:00100000:3.0:1788509503.786270:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774776576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509503.786324:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774776576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 54us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509503.786332:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 342 00000100:00100000:3.0:1788509503.786347:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 343 00000100:00100000:3.0:1788509503.786353:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2408:x1875387774775936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509503.786382:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2408:x1875387774775936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509503.786387:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 343 00000100:00100000:3.0:1788509503.786409:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 344 00000100:00100000:3.0:1788509503.786435:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774776448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509503.786462:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2408:x1875387774776448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509503.786468:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 344 00000100:00080000:2.0:1788509503.786592:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509503.786596:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788509504.407428:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509504.735405:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509504.735581:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774776704 00000100:00100000:3.0:1788509504.735594:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774776704 00000100:00100000:3.0:1788509504.735680:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:3.0:1788509504.735692:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:12158:x1875387774776704:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788509504.736016:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:12158:x1875387774776704:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 325us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509504.736025:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:2.0:1788509504.739087:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509504.739201:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774776832 00000100:00100000:0.0:1788509504.739225:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774776832 00000100:00100000:0.0:1788509504.739352:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:0.0:1788509504.739364:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:12158:x1875387774776832:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788509504.739523:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:12158:x1875387774776832:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 162us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509504.739967:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:2.0:1788509504.743246:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509504.744694:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774777088 00000100:00100000:0.0:1788509504.744713:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774777088 00000100:00100000:0.0:1788509504.744807:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1788509504.744821:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:12158:x1875387774777088:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788509504.745434:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:12158:x1875387774777088:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 613us (2199us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788509504.745445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1788509505.126309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509505.126887:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774777216 00000100:00100000:0.0:1788509505.126933:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774777216 00000100:00100000:0.0:1788509505.127098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:0.0:1788509505.127114:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:12961:x1875387774777216:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:0.0:1788509505.127140:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509505.127169:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de92a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553431 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509505.127261:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de931 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509505.127278:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509505.127295:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509505.127356:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788509505.127360:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509505.127422:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509505.127451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310de92a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553431 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509505.127476:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553431 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509505.127485:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:0.0:1788509505.127488:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509505.127493:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846e800, rc 0) 00000100:00100000:0.0:1788509505.127595:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:12961:x1875387774777216:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 486us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509505.127603:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00080000:2.0:1788509505.131422:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788509505.431652:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509506.454162:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509507.289528:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509507.289560:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796837504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509507.289655:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509507.289985:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796837504 00000100:00100000:1.0:1788509507.289996:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796837504 00000100:00100000:1.0:1788509507.290062:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788509507.290073:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796837504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509507.290115:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788509507.290199:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796837504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509507.290207:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788509507.290365:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796837504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788509507.479426:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509507.798321:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509507.798352:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796837632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509507.798454:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509507.798730:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796837632 00000100:00100000:0.0:1788509507.798741:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796837632 00000100:00100000:0.0:1788509507.798829:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788509507.798841:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796837632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509507.798881:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788509507.798965:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796837632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509507.798973:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1788509507.799172:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509507.799536:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788509507.799543:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1788509507.799586:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcc87dfc380, transno 4294967311 00000100:00100000:0.0:1788509507.799618:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796837632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509507.799969:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509507.799983:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796837888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509507.800036:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509507.800119:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796837760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509507.800142:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796837888 00000100:00100000:1.0:1788509507.800152:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796837888 00000100:00100000:1.0:1788509507.800216:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788509507.800226:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796837888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509507.800245:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788509507.800292:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796837888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509507.800299:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788509507.800586:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796838016:0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.800629:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509507.800631:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796838144:0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.800658:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796838528:0@lo:400:kworker.0 00000100:00100000:2.0:1788509507.800688:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509507.800721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796838656:0@lo:400:kworker.0 00000100:00100000:2.0:1788509507.800746:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509507.800767:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796839168:0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.800768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796838016 00000100:00100000:3.0:1788509507.800775:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796838016 00000100:00100000:3.0:1788509507.800811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788509507.800818:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3645:x1875387796838016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.800853:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3645:x1875387796838016:12345-0@lo:400:kworker.0 Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509507.800863:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788509507.800865:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788509507.800923:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509507.800931:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796838272:0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.800947:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509507.800964:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509507.800976:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796839040:0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.800989:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796838784:0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.801009:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509507.801054:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796837888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509507.801072:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796838016:0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.801080:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788509507.801086:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796838400:0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.801109:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509507.801121:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796838912:0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.801152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796838144 00000100:00100000:3.0:1788509507.801156:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796838144 00000100:00100000:3.0:1788509507.801182:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796838656 00000100:00100000:3.0:1788509507.801185:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796838656 00000100:00100000:3.0:1788509507.801206:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796838528 00000100:00100000:3.0:1788509507.801209:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796838528 00000100:00100000:3.0:1788509507.801220:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796839040 00000100:00100000:3.0:1788509507.801222:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796839040 00000100:00100000:3.0:1788509507.801234:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796838400 00000100:00100000:3.0:1788509507.801237:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796838400 00000100:00100000:3.0:1788509507.801251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788509507.801257:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796838144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509507.801294:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796838144:12345-0@lo:400:kworker.0 Request processed in 37us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509507.801301:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788509507.801303:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509507.801316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788509507.801323:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796838656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.801357:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796837760 00000100:00100000:3.0:1788509507.801361:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796838656:12345-0@lo:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509507.801372:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796837760 00000100:00100000:3.0:1788509507.801386:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788509507.801405:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788509507.801406:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796838272 00000100:00100000:0.0:1788509507.801411:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796838272 00000100:00100000:3.0:1788509507.801414:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796838528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.801433:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788509507.801442:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875387796837760:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509507.801455:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796838528:12345-0@lo:400:kworker.0 Request processed in 43us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509507.801462:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000004:00000024:0.0:1788509507.801474:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788509507.801479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788509507.801487:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796839040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.801519:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875387796837760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509507.801526:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788509507.801540:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788509507.801545:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796838272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.801572:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796838272:12345-0@lo:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509507.801579:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788509507.801602:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788509507.801615:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796838400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.801648:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796838400:12345-0@lo:400:kworker.0 Request processed in 34us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509507.801654:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788509507.801685:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796838272:0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.801699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796837760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509507.801741:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796838784 00000100:00100000:0.0:1788509507.801745:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796838784 00000100:00100000:0.0:1788509507.801779:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788509507.802147:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788509507.802160:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509507.802174:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509507.802177:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509507.802197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796839168 00000100:00100000:1.0:1788509507.802201:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796839168 00000100:00100000:2.0:1788509507.802211:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796838144:0@lo:400:kworker.0 00010000:00080000:2.0:1788509507.802230:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781180 x1875387796838656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509507.802240:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788509507.802249:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796838656:0@lo:400:kworker.0 00000100:00100000:1.0:1788509507.802255:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796839168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509507.802303:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509507.802314:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796839168:12345-0@lo:400:kworker.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509507.802323:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788509507.802341:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796838528:0@lo:400:kworker.0 00000100:00080000:1.0:1788509507.802359:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509507.802376:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796838400:0@lo:400:kworker.0 00010000:00080000:1.0:1788509507.802399:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781c00 x1875387796839168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509507.802404:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796838912 00000100:00100000:2.0:1788509507.802410:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796838912 00000100:00100000:1.0:1788509507.802414:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796839168:0@lo:400:kworker.0 00000100:00080000:1.0:1788509507.802436:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509507.802455:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788509507.802463:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796838912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509507.802509:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796838912:12345-0@lo:400:kworker.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509507.802516:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788509507.802791:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796839040:12345-0@lo:400:kworker.0 Request processed in 1304us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509507.802799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788509507.802878:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788509507.802885:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967325 00000004:00080000:1.0:1788509507.802921:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcd913e5880, transno 4294967325 00000100:00100000:1.0:1788509507.802939:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796838912:0@lo:400:kworker.0 00000100:00100000:1.0:1788509507.802954:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796839040:0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.803672:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796838784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509507.803760:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796838784:12345-0@lo:400:kworker.0 Request processed in 1974us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509507.803770:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788509507.803968:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796838784:0@lo:400:kworker.0 00000100:00100000:1.0:1788509508.310455:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788509508.310496:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796839296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788509508.310590:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509508.310960:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796839296 00000100:00100000:0.0:1788509508.310970:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796839296 00000100:00100000:0.0:1788509508.311040:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788509508.311051:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796839296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509508.311089:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788509508.311145:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796839296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509508.311152:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788509508.311935:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796839424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509508.311989:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509508.312209:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796839296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509508.312442:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796839424 00000100:00100000:0.0:1788509508.312450:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796839424 00000100:00100000:0.0:1788509508.312504:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788509508.312614:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796839424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509508.312634:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788509508.312706:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796839424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 193us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509508.312712:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788509508.314534:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796839424:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788509508.502077:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788509508.834519:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788509508.834542:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788509508.834608:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788509508.834622:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788509508.889353:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509508.889411:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509508.889465:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509508.889495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509508.889519:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509508.889543:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509508.889572:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509508.889611:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774777856 00000100:00100000:2.0:1788509508.889623:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774777856 00000100:00100000:2.0:1788509508.889695:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774777728 00000100:00100000:2.0:1788509508.889698:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774777728 00000100:00100000:2.0:1788509508.889729:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:2.0:1788509508.889745:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774777856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509508.889835:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774777856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509508.889844:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:2.0:1788509508.889867:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:2.0:1788509508.889875:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2409:x1875387774777728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509508.889945:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2409:x1875387774777728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509508.889953:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:2.0:1788509508.889983:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774777600 00000100:00100000:2.0:1788509508.889988:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774777600 00000100:00100000:2.0:1788509508.890012:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774778112 00000100:00100000:2.0:1788509508.890015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774778112 00000100:00100000:2.0:1788509508.890027:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774777472 00000100:00100000:2.0:1788509508.890030:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774777472 00000100:00100000:2.0:1788509508.890043:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774777984 00000100:00100000:2.0:1788509508.890046:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774777984 00000100:00100000:2.0:1788509508.890060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 351 00000100:00100000:2.0:1788509508.890074:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774777600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509508.890105:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2409:x1875387774777600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509508.890111:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 351 00000100:00100000:2.0:1788509508.890130:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 352 00000100:00100000:2.0:1788509508.890138:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774778112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509508.890168:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774778112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509508.890176:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 352 00000100:00100000:2.0:1788509508.890196:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 353 00000100:00100000:2.0:1788509508.890202:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2409:x1875387774777472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509508.890235:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:2409:x1875387774777472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509508.890241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 353 00000100:00100000:2.0:1788509508.890253:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 354 00000100:00100000:2.0:1788509508.890259:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774777984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509508.890288:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774777984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509508.890294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 354 00000100:00080000:2.0:1788509508.890333:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509508.890340:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509508.890344:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509508.890347:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509508.890647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774777344 00000100:00100000:0.0:1788509508.890652:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774777344 00000100:00100000:0.0:1788509508.890702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 393 00000100:00100000:0.0:1788509508.890711:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774777344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509508.890759:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2409:x1875387774777344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 51us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509508.890766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 393 00000001:02000400:0.0:1788509508.953348:0:14957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:11:46 (1788509506) 00010000:00010000:0.0:1788509509.527964:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788509510.294229:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788509510.294241:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509510.294578:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788509510.294593:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788509510.550175:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509511.000860:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788509511.575018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509512.408874:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796839552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509512.408987:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509512.409136:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796839552 00000100:00100000:0.0:1788509512.409144:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796839552 00000100:00100000:0.0:1788509512.409195:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788509512.409204:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796839552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788509512.409236:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788509512.409296:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796839552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.409303:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788509512.409446:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796839552:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509512.599318:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509512.918199:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796840064:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918282:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509512.918361:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796840576:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918391:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509512.918411:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796841088:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918432:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509512.918460:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788509512.918465:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796839936:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918488:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509512.918505:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796840448:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918525:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509512.918541:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796840960:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918560:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509512.918589:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796840576 00000100:00100000:1.0:1788509512.918595:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796840576 00000100:00100000:1.0:1788509512.918653:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796841088 00000100:00100000:1.0:1788509512.918657:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796841088 00000100:00100000:1.0:1788509512.918677:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788509512.918688:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796840576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918738:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796840576:12345-0@lo:400:kworker.0 Request processed in 52us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509512.918745:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788509512.918790:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788509512.918797:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796841088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918828:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796841088:12345-0@lo:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509512.918834:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788509512.918854:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796839936 00000100:00100000:1.0:1788509512.918857:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796839936 00000100:00100000:1.0:1788509512.918880:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788509512.918886:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796839936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.918945:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796839936:12345-0@lo:400:kworker.0 Request processed in 57us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509512.918951:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788509512.918993:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796839936:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.919003:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796840576:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.919011:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796841088:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.919477:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796839808:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.919521:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509512.919550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796840320:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.919571:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509512.919590:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796840832:0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.919603:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796840064 00000100:00100000:3.0:1788509512.919608:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796840064 00000100:00100000:0.0:1788509512.919610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509512.919620:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796841344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509512.919632:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796840448 00000100:00100000:3.0:1788509512.919635:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796840448 00000100:00100000:3.0:1788509512.919650:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796840960 00000100:00100000:3.0:1788509512.919653:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796840960 00000100:00100000:0.0:1788509512.919655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509512.919675:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796839808 00000100:00100000:0.0:1788509512.919677:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788509512.919678:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796839808 00000100:00100000:0.0:1788509512.919684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796839680:0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.919690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796840320 00000100:00100000:3.0:1788509512.919692:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796840320 00000100:00100000:3.0:1788509512.919703:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796840832 00000100:00100000:3.0:1788509512.919705:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796840832 00000100:00100000:0.0:1788509512.919709:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509512.919718:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788509512.919725:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796840064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.919729:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796840192:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.919749:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509512.919760:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796840064:12345-0@lo:400:kworker.0 Request processed in 36us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.919765:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796840704:0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.919786:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788509512.919788:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509512.919801:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788509512.919801:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796841216:0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.919807:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796840448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.919819:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509512.919833:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796840448:12345-0@lo:400:kworker.0 Request processed in 27us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509512.919839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788509512.919840:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796841472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509512.919856:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788509512.919863:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796840960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.919868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509512.919889:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796840960:12345-0@lo:400:kworker.0 Request processed in 27us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509512.919895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788509512.919896:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796841344 00000100:00100000:0.0:1788509512.919914:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796841344 00000100:00100000:3.0:1788509512.919925:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788509512.919930:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796839808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.919940:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796841472 00000100:00100000:0.0:1788509512.919943:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796841472 00000100:00100000:0.0:1788509512.919956:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788509512.919961:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796839808:12345-0@lo:400:kworker.0 Request processed in 31us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.919962:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796841344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509512.919968:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788509512.919977:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788509512.919982:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796840320:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788509512.919983:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509512.920007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796840320:12345-0@lo:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509512.920014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788509512.920015:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796841344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.920021:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788509512.920024:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788509512.920029:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796840832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.920031:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788509512.920036:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796841472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788509512.920044:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509512.920052:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796840832:12345-0@lo:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509512.920063:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788509512.920067:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796841472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.920072:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788509512.920085:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796839680 00000100:00100000:0.0:1788509512.920088:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796839680 00000100:00100000:3.0:1788509512.920097:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796839808:0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.920107:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796840320:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.920110:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788509512.920116:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796840832:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.920116:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796839680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.920130:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796841344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509512.920142:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda637b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796839680:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.920148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788509512.920151:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796839680:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.920169:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796840704 00000100:00100000:0.0:1788509512.920173:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796840704 00000100:00100000:0.0:1788509512.920190:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796841216 00000100:00100000:0.0:1788509512.920192:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796841216 00000100:00100000:3.0:1788509512.920193:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796840192 00000100:00100000:3.0:1788509512.920196:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796840192 00000100:00100000:0.0:1788509512.920203:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788509512.920208:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796840704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.920216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788509512.920221:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796840192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.920250:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796840192:12345-0@lo:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.920253:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796840704:12345-0@lo:400:kworker.0 Request processed in 45us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509512.920256:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788509512.920258:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788509512.920267:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788509512.920273:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796841216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.920294:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796840192:0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.920303:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796840704:0@lo:400:kworker.0 00000100:00100000:3.0:1788509512.920311:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796841216:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.920318:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796841216:12345-0@lo:400:kworker.0 Request processed in 46us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.920325:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788509512.920434:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509512.920439:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509512.920442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788509512.920444:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509512.920660:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796841600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509512.920693:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509512.926166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796841472:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788509512.937960:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87780e00 x1875387796840448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509512.937978:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796840448:0@lo:400:kworker.0 00010000:00080000:1.0:1788509512.937994:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87781f80 x1875387796840960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509512.938002:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796840960:0@lo:400:kworker.0 00000100:00100000:1.0:1788509512.938040:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796840064:0@lo:400:kworker.0 00000100:00100000:0.0:1788509512.938157:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796841600 00000100:00100000:0.0:1788509512.938164:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796841600 00000100:00100000:0.0:1788509512.938225:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788509512.938472:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796841600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509512.938515:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788509512.938700:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796841600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 466us (18005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509512.938709:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788509512.944459:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796841600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509513.433511:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796841728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509513.433587:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509513.433691:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796841856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509513.433722:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509513.433761:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796841728 00000100:00100000:0.0:1788509513.433769:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796841728 00000100:00100000:0.0:1788509513.433807:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796841856 00000100:00100000:0.0:1788509513.433810:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796841856 00000100:00100000:0.0:1788509513.434301:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788509513.434312:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796841728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509513.434355:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788509513.434461:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788509513.434476:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796841856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788509513.434488:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788509513.434546:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796841856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509513.434553:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788509513.434605:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796841856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509513.445218:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796841728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10897us (11620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509513.445235:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788509513.446861:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796841728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788509513.622297:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509513.842724:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509513.842838:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774778368 00000100:00100000:0.0:1788509513.842861:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774778368 00000100:00100000:0.0:1788509513.842967:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:0.0:1788509513.842979:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+18:13184:x1875387774778368:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:0.0:1788509513.843238:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:13184:x1875387774778368:12345-192.168.203.12@tcp:35:umount.0 Request processed in 261us (523us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788509513.843247:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00080000:2.0:1788509513.843728:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509513.845533:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509513.854697:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774778624 00000100:00100000:2.0:1788509513.854720:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774778624 00000100:00100000:2.0:1788509513.854819:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1788509513.854832:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+19:13184:x1875387774778624:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:2.0:1788509513.855436:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:13184:x1875387774778624:12345-192.168.203.12@tcp:35:umount.0 Request processed in 603us (9912us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788509513.855445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1788509513.858636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509513.858754:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774778880 00000100:00100000:3.0:1788509513.858765:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774778880 00000100:00100000:3.0:1788509513.858858:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788509513.858867:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdaf88ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+20:13184:x1875387774778880:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:3.0:1788509513.859149:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdaf88ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:13184:x1875387774778880:12345-192.168.203.12@tcp:35:umount.0 Request processed in 281us (530us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788509513.859156:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788509513.862124:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509513.862265:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774779136 00000100:00100000:2.0:1788509513.862276:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774779136 00000100:00100000:2.0:1788509513.862352:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788509513.862362:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:13184:x1875387774779136:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:2.0:1788509513.862737:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:13184:x1875387774779136:12345-192.168.203.12@tcp:35:umount.0 Request processed in 376us (620us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788509513.862746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788509513.873254:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509513.873288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509513.873316:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509513.873412:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774779392 00000100:00100000:3.0:1788509513.873425:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774779392 00000100:00100000:2.0:1788509513.873444:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774779264 00000100:00100000:2.0:1788509513.873459:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774779264 00000100:00100000:3.0:1788509513.873501:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774779520 00000100:00100000:3.0:1788509513.873506:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774779520 00000100:00100000:2.0:1788509513.873527:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788509513.873539:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+15:2408:x1875387774779392:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509513.875416:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509513.875447:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8600/0xe5156b86310dd84b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f45 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509513.875467:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509513.875530:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+14:2408:x1875387774779392:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1993us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509513.880143:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788509513.880174:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+14:2408:x1875387774779264:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509513.880201:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509513.880423:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924c00/0xe5156b86310dd88a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f84 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509513.880449:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509513.880524:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+13:2408:x1875387774779264:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 365us (7234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509513.880533:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788509513.880561:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788509513.880568:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:2408:x1875387774779520:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509513.880576:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509513.880587:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227e00/0xe5156b86310ddb5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755305d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509513.880595:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509513.880628:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+11:2408:x1875387774779520:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 61us (7310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509513.880634:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788509513.881566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509513.881992:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774779648 00000100:00100000:1.0:1788509513.882008:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774779648 00000100:00100000:1.0:1788509513.882360:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1788509513.882376:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2406:x1875387774779648:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:1.0:1788509513.882406:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310ddc26 00000100:00080000:1.0:1788509513.882416:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8bcc87c87000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788509513.882463:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:3.0:1788509513.882496:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788509513.882518:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509513.882613:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d1c7a223-cc58-4f2c-be22-e37eba96eeae+2:2406:x1875387774779648:12345-192.168.203.12@tcp:9:umount.0 Request processed in 241us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509513.882623:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1788509513.882996:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788509513.890135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509513.894869:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774780032 00000100:00100000:2.0:1788509513.894891:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774780032 00000100:00100000:2.0:1788509513.895105:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:2.0:1788509513.895118:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+7:2406:x1875387774780032:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:2.0:1788509513.895158:0:8756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dde9c 00000020:00010000:2.0:1788509513.895167:0:8756:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bcc867ec000: total 0 00000100:00080000:2.0:1788509513.895173:0:8756:0:(import.c:65:import_set_state_nolock()) ffff8bcc867ef800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788509513.895229:0:8756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788509513.895469:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2406:x1875387774780032:12345-192.168.203.12@tcp:9:umount.0 Request processed in 353us (5351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509513.895478:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000020:00010000:0.0:1788509513.896402:0:6509:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bcc867ec000: total 0 00010000:00010000:0.0:1788509513.896497:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bcc867ec000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788509513.896574:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094d32a1b/0xe5156b86310de923 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755342a expref: 4 pid: 8756 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509513.896620:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310de254 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553247 expref: 3 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509513.896636:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bcc867ec000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788509513.896650:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509513.896652:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509513.896654:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788509513.897360:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509513.904991:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509513.905125:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774781056 00000100:00100000:3.0:1788509513.905138:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774781056 00000100:00100000:3.0:1788509513.905216:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:3.0:1788509513.905229:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+22:2406:x1875387774781056:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:3.0:1788509513.905273:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd859 00000020:00010000:3.0:1788509513.905295:0:6522:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bcdb786c800: total 0 00000100:00080000:3.0:1788509513.905302:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8bcdb786a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788509513.905354:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1788509513.905563:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1c7a223-cc58-4f2c-be22-e37eba96eeae+21:2406:x1875387774781056:12345-192.168.203.12@tcp:39:umount.0 Request processed in 336us (587us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788509513.905571:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 258 00000020:00010000:1.0:1788509513.905688:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bcdb786c800: total 0 00010000:00010000:1.0:1788509513.905694:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509513.905756:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bcdb786c800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788509513.905797:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc87343900) 00010000:00010000:1.0:1788509513.905800:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509513.905826:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9400/0xe5156b86310ddba1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553072 expref: 20 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.905855:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:1.0:1788509513.905858:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509513.905862:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc87ce3600/0xe5156b86310de215 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553232 expref: 19 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.905875:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:1.0:1788509513.905877:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788509513.905881:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b000/0xe5156b86310de23f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553240 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.905946:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:1.0:1788509513.905949:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788509513.905954:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590aa00/0xe5156b86310de2bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553263 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.905971:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509513.905973:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788509513.905977:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80031a00/0xe5156b86310de804 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475533dd expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.905992:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:1.0:1788509513.905994:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788509513.905998:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310ddef7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553160 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.906012:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8bcd83aef800) 00010000:00010000:1.0:1788509513.906021:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788509513.906026:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc1f4be00/0xe5156b86310ddb85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755306b expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.906047:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509513.906050:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788509513.906054:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdc2073e00/0xe5156b86310de2d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755326a expref: 13 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.906067:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bcc8761e700) 00010000:00010000:1.0:1788509513.906069:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788509513.906073:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226000/0xe5156b86310de135 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475531fa expref: 12 pid: 9006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.906089:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8bcd8cb0df00) 00010000:00010000:1.0:1788509513.906092:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788509513.906095:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030000/0xe5156b86310ddbfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553087 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.906111:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8bcc8761e800) 00010000:00010000:1.0:1788509513.906114:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788509513.906118:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9c00/0xe5156b86310de5c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553343 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.906132:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509513.906135:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788509513.906138:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af200/0xe5156b86310de8e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553415 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.906164:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8bcdbd047500) 00010000:00010000:1.0:1788509513.906167:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788509513.906171:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdbd3d9200/0xe5156b86310de90e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553423 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509513.906185:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bcdb786c800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788509513.906199:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509513.906201:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509513.906203:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509513.915568:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509513.915687:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774781184 00000100:00100000:2.0:1788509513.915699:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774781184 00000100:00100000:2.0:1788509513.915791:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00080000:3.0:1788509513.915794:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509513.915809:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+5:2406:x1875387774781184:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:2.0:1788509513.915853:0:9006:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd860 00000100:00080000:2.0:1788509513.915876:0:9006:0:(import.c:65:import_set_state_nolock()) ffff8bcdb59c6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788509513.915943:0:9006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788509513.916151:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1c7a223-cc58-4f2c-be22-e37eba96eeae+3:2406:x1875387774781184:12345-192.168.203.12@tcp:39:umount.0 Request processed in 349us (596us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788509513.916177:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 259 00010000:00010000:1.0:1788509513.916292:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509514.012146:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509514.012205:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509514.012294:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774781440 00000100:00100000:3.0:1788509514.012304:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774781440 00000100:00100000:3.0:1788509514.012394:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774781312 00000100:00100000:3.0:1788509514.012398:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774781312 00000100:00100000:3.0:1788509514.012423:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 361 00000100:00100000:3.0:1788509514.012432:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774781440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509514.012518:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2409:x1875387774781440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 85us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509514.012526:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 361 00000100:00100000:3.0:1788509514.012545:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 362 00000100:00100000:3.0:1788509514.012560:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774781312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509514.012593:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2409:x1875387774781312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509514.012602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 362 00000100:00080000:0.0:1788509514.013590:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509514.013597:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788509514.646048:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509515.670212:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788509515.998241:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000001:00080000:2.0:1788509515.998257:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788509515.998270:0:6499:0:(genops.c:885:class_export_put()) final put ffff8bcdb786c800/d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:3.0:1788509516.003022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb786c800/d1c7a223-cc58-4f2c-be22-e37eba96eeae for lustre-MDT0000 00000020:00000080:3.0:1788509516.007231:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb786a000 for lustre-MDT0000 00000100:00100000:3.0:1788509516.189159:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509516.189202:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509516.189235:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509516.191320:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774781568 00000100:00100000:1.0:1788509516.191334:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774781568 00000100:00100000:2.0:1788509516.193432:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774781824 00000100:00100000:0.0:1788509516.193432:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774781696 00000100:00100000:2.0:1788509516.193444:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774781824 00000100:00100000:0.0:1788509516.193444:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774781696 00000100:00100000:2.0:1788509516.193512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788509516.193522:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89172850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:2410:x1875387774781568:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509516.193538:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788509516.193550:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788509516.193559:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+12:2410:x1875387774781696:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509516.193559:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8800/0xe5156b86310dd95c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f99 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509516.193567:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509516.193574:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226600/0xe5156b86310dd963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552fca expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509516.193575:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788509516.193594:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509516.193664:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+10:2410:x1875387774781696:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 106us (4427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509516.193671:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788509516.193689:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788509516.193695:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+9:2410:x1875387774781824:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509516.193707:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509516.193715:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227a00/0xe5156b86310ddb54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553056 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509516.193724:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509516.193758:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+8:2410:x1875387774781824:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 63us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509516.193765:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788509516.194797:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89172850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+7:2410:x1875387774781568:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1203us (5574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509516.194807:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788509516.204109:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509516.204439:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774782080 00000100:00100000:2.0:1788509516.204450:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774782080 00000100:00100000:2.0:1788509516.204574:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:2.0:1788509516.204597:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+6:2406:x1875387774782080:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:2.0:1788509516.204957:0:9006:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd971 00000020:00010000:2.0:1788509516.204966:0:9006:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bcdb786d800: total 0 00000100:00080000:2.0:1788509516.204972:0:9006:0:(import.c:65:import_set_state_nolock()) ffff8bcdb786b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788509516.204997:0:9006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788509516.205165:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2406:x1875387774782080:12345-192.168.203.12@tcp:39:umount.0 Request processed in 571us (1066us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788509516.205188:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00080000:3.0:1788509516.205274:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788509516.205607:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bcdb786d800: total 0 00010000:00010000:0.0:1788509516.205682:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bcdb786d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788509516.205719:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87630900) 00010000:00010000:0.0:1788509516.205723:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509516.205733:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310de931 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553431 expref: 4 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509516.205758:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bcdb786d800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788509516.205771:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509516.205773:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509516.205775:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509516.217418:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509516.217739:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774782208 00000100:00100000:2.0:1788509516.217750:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774782208 00000100:00100000:2.0:1788509516.217828:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:2.0:1788509516.217840:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+5:2406:x1875387774782208:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:2.0:1788509516.217877:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd978 00000100:00080000:2.0:1788509516.217887:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8bcdb7869000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788509516.217941:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:3.0:1788509516.218114:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509516.218248:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b56a23-ddae-407e-b137-3c943d18cb4f+3:2406:x1875387774782208:12345-192.168.203.12@tcp:39:umount.0 Request processed in 410us (839us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788509516.218256:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 261 00010000:00010000:1.0:1788509516.222324:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509516.255712:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509516.259829:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774782464 00000100:00100000:2.0:1788509516.259844:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774782464 00000100:00100000:3.0:1788509516.260169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 395 00000100:00100000:3.0:1788509516.260183:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+7:2406:x1875387774782464:12345-192.168.203.12@tcp:251:umount.0 00000020:00000080:3.0:1788509516.260232:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd836 00000020:00010000:3.0:1788509516.260240:0:6514:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bcdb5974800: total 0 00000100:00080000:3.0:1788509516.260244:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8bcdb5975000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788509516.260300:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bcdb5974800: total 0 00010000:00010000:0.0:1788509516.260315:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509516.260375:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bcdb5974800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788509516.260423:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590ba00/0xe5156b86310dd891 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647552f8b expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509516.260440:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bcdb5974800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788509516.260451:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509516.260453:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509516.260455:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509516.260472:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac7445cb-a9c1-4029-81e7-bb23f1aa1f24+1:2406:x1875387774782464:12345-192.168.203.12@tcp:251:umount.0 Request processed in 291us (4767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509516.260480:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 395 00000020:00000080:3.0:1788509516.260490:0:6514:0:(genops.c:885:class_export_put()) final put ffff8bcdb5974800/ac7445cb-a9c1-4029-81e7-bb23f1aa1f24 00000020:00000080:2.0:1788509516.260613:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb5974800/ac7445cb-a9c1-4029-81e7-bb23f1aa1f24 for MGS 00000020:00000080:2.0:1788509516.260667:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb5975000 for MGS 00010000:00010000:1.0:1788509516.694143:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509517.527860:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509517.527891:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796841984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509517.528132:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509517.528246:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796841984 00000100:00100000:3.0:1788509517.528258:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796841984 00000100:00100000:3.0:1788509517.528343:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788509517.528355:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796841984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509517.528410:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788509517.528555:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796841984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509517.528563:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788509517.528614:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796841984:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788509517.719207:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509518.039200:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796842112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509518.039307:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.039896:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796842112 00000100:00100000:1.0:1788509518.040058:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796842112 00000100:00100000:3.0:1788509518.040546:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796842240:0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.041047:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788509518.041072:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796842112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788509518.041119:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788509518.042016:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796842112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 942us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.042026:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788509518.042093:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796842368:0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.042139:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.042189:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796842880:0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.042212:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.042233:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796843392:0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.042252:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.042273:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796843904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509518.042311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.042356:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796842368 00000100:00100000:1.0:1788509518.042363:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796842368 00000100:00100000:1.0:1788509518.042419:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796842880 00000100:00100000:1.0:1788509518.042423:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796842880 00000100:00100000:1.0:1788509518.042450:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796843392 00000100:00100000:1.0:1788509518.042453:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796843392 00000100:00100000:1.0:1788509518.042470:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788509518.042478:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796842368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.042526:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796842368:12345-0@lo:400:kworker.0 Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.042534:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788509518.042549:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788509518.042556:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796842880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.042597:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796842880:12345-0@lo:400:kworker.0 Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.042604:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788509518.042620:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788509518.042626:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796843392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.042656:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796843392:12345-0@lo:400:kworker.0 Request processed in 31us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.042661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788509518.042681:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796843904 00000100:00100000:1.0:1788509518.042685:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796843904 00000100:00100000:1.0:1788509518.042713:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788509518.042719:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796843904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509518.042743:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788509518.042772:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509518.042772:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796843904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.042778:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788509518.042807:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796842496:0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.042846:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.042864:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796843008:0@lo:400:kworker.0 00000100:00080000:2.0:1788509518.042867:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509518.042890:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509518.045510:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796843008 00000100:00100000:2.0:1788509518.045529:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796843008 00000100:00100000:2.0:1788509518.045798:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788509518.045814:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796843008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.047076:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796843520:0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.050311:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509518.050370:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796843008:12345-0@lo:400:kworker.0 Request processed in 4559us (7475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509518.050385:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788509518.050392:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796842752:0@lo:400:kworker.0 00000100:00080000:2.0:1788509518.050449:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509518.050458:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509518.051214:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796842368:0@lo:400:kworker.0 00010000:00080000:0.0:1788509518.051235:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7878380 x1875387796842880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509518.051260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796842880:0@lo:400:kworker.0 00010000:00080000:0.0:1788509518.051276:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913d6680 x1875387796843392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509518.051284:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796843392:0@lo:400:kworker.0 00000100:00100000:0.0:1788509518.051322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796843904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509518.051393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796842624:0@lo:400:kworker.0 00000100:00100000:0.0:1788509518.051449:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509518.051722:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796843136:0@lo:400:kworker.0 00000100:00100000:0.0:1788509518.051754:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509518.051777:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796843648:0@lo:400:kworker.0 00000100:00100000:0.0:1788509518.051798:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509518.052005:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796842112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509518.052055:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796842496 00000100:00100000:0.0:1788509518.052063:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796842496 00000100:00100000:0.0:1788509518.052110:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796842752 00000100:00100000:0.0:1788509518.052113:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796842752 00000100:00100000:0.0:1788509518.052141:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788509518.052149:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796842496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509518.052205:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875387796842496:12345-0@lo:400:kworker.0 Request processed in 57us (9359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509518.052212:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788509518.052228:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788509518.052234:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796842752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509518.052278:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796842752:12345-0@lo:400:kworker.0 Request processed in 44us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509518.052283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788509518.052586:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796842752:0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.052597:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796843264:0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.052630:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509518.052646:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796843776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509518.052668:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509518.052716:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796842240 00000100:00100000:3.0:1788509518.052720:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796842240 00000100:00100000:3.0:1788509518.052752:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788509518.052758:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796842240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.052794:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3646:x1875387796842240:12345-0@lo:400:kworker.0 Request processed in 36us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.052800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788509518.053075:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796842624 00000100:00100000:3.0:1788509518.053080:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796842624 00000100:00100000:3.0:1788509518.053108:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788509518.053114:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796842624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.053154:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796842624:12345-0@lo:400:kworker.0 Request processed in 40us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.053160:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788509518.053178:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796843776 00000100:00100000:3.0:1788509518.053181:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796843776 00000100:00100000:3.0:1788509518.053217:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788509518.053223:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796843776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509518.053239:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509518.053310:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796843776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.053316:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788509518.053348:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796842624:0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.053370:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3646:1875387796842240:0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.053387:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796843776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509518.054057:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796843136 00000100:00100000:3.0:1788509518.054065:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796843136 00000100:00100000:3.0:1788509518.054105:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796843648 00000100:00100000:3.0:1788509518.054108:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796843648 00000100:00100000:3.0:1788509518.054134:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788509518.054141:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796843136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.054202:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796843136:12345-0@lo:400:kworker.0 Request processed in 60us (2445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.054209:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788509518.054222:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788509518.054229:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796843648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.054257:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796843648:12345-0@lo:400:kworker.0 Request processed in 29us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.054262:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788509518.054279:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796843264 00000100:00100000:3.0:1788509518.054282:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796843264 00000100:00100000:3.0:1788509518.054325:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788509518.054332:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796843264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.054367:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796843264:12345-0@lo:400:kworker.0 Request processed in 36us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.054385:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788509518.055116:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796843136:0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.055133:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796843648:0@lo:400:kworker.0 00000100:00100000:3.0:1788509518.055198:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796843264:0@lo:400:kworker.0 00000100:00080000:3.0:1788509518.055235:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509518.055241:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509518.055244:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509518.056733:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.056779:0:8756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796843520 00000100:00100000:1.0:1788509518.056789:0:8756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796843520 00000100:00100000:1.0:1788509518.056858:0:8756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788509518.056869:0:8756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796843520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.056964:0:8756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796843520:12345-0@lo:400:kworker.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.056973:0:8756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788509518.057042:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796843520:0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.057074:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875387796842496:0@lo:400:kworker.0 00000100:00100000:1.0:1788509518.057089:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796843008:0@lo:400:kworker.0 00000020:01000004:1.0:1788509518.199007:0:15153:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788509518.221176:0:15153:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788509518.221247:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.221264:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.221272:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.221280:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.221321:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788509518.221327:0:15153:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788509518.221367:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788509518.221373:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788509518.221380:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788509518.221415:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf0c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788509518.221456:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796844032:0@lo:39:umount.0 00000100:00100000:1.0:1788509518.221555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788509518.222377:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509518.222390:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509518.222401:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509518.222406:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509518.222417:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788509518.222426:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509518.222432:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788509518.222434:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788509518.222437:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788509518.222489:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509518.222495:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509518.222533:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509518.222541:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92925600/0xe5156b86310dd8ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509518.222556:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796844160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509518.222558:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509518.222561:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509518.222563:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509518.222582:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796844032 00000100:00100000:3.0:1788509518.222598:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796844032 00000100:00100000:1.0:1788509518.222625:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509518.222662:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788509518.222674:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875387796844032:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788509518.222706:0:9006:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd44d 00000100:00080000:3.0:1788509518.222717:0:9006:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf0a800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788509518.222795:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875387796844032:12345-0@lo:39:umount.0 Request processed in 124us (1239us total) trans 0 rc 0/0 00010000:00010000:1.0:1788509518.222796:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509518.222806:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788509518.222818:0:9006:0:(genops.c:885:class_export_put()) final put ffff8bcd83762000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788509518.222861:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796844160 00000100:00100000:3.0:1788509518.222865:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796844160 00000100:00100000:3.0:1788509518.222893:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788509518.222919:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3644:x1875387796844160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509518.222932:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509518.222948:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd80031600/0xe5156b86310dd8f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd8ec expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509518.222962:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509518.222987:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:3644:x1875387796844160:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.223000:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788509518.223036:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796844160:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788509518.223062:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf0c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788509518.223069:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796844032:0@lo:39:umount.0 00000020:00000080:1.0:1788509518.223837:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd83762000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788509518.223982:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdbbf0a800 for lustre-MDT0000 00000100:00080000:1.0:1788509518.224004:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788509518.224112:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788509518.224118:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788509518.230068:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230091:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230099:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230106:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230125:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788509518.230131:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230138:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230144:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230166:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230179:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788509518.230210:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509518.230217:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230224:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031400 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509518.230229:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230238:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509518.230246:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509518.230252:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788509518.230255:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788509518.230306:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230314:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509518.230339:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230347:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd80031400/0xe5156b86310dd8fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd901 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230375:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509518.230378:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230384:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924200 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509518.230387:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230394:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509518.230402:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509518.230407:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788509518.230408:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788509518.230410:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788509518.230428:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230434:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509518.230454:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230461:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92924200/0xe5156b86310dd7f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd7f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230471:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509518.230473:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509518.230481:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509518.230494:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509518.230518:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796844416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509518.230601:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509518.230662:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230671:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230677:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230683:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230694:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788509518.230700:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509518.230704:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230710:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc1f4b200 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509518.230713:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230721:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509518.230730:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509518.230747:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788509518.230749:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788509518.230752:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788509518.230772:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230778:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509518.230789:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230795:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdc1f4b200/0xe5156b86310ddb46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310ddb4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.230810:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509518.230812:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509518.230814:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509518.230825:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796844544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509518.230848:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.230887:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796844416 00000100:00100000:1.0:1788509518.230925:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796844416 00000100:00100000:1.0:1788509518.230978:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796844544 00000100:00100000:1.0:1788509518.230982:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796844544 00000100:00100000:1.0:1788509518.231003:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788509518.231012:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+24:3647:x1875387796844416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509518.231027:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509518.231043:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924e00/0xe5156b86310dd7f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd7f0 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231056:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509518.231099:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+23:3647:x1875387796844416:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.231107:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788509518.231144:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788509518.231151:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:3647:x1875387796844544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509518.231158:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509518.231167:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9800/0xe5156b86310ddb4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310ddb46 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231177:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509518.231200:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3647:x1875387796844544:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.231205:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788509518.231243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796844544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509518.231251:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3647:1875387796844416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509518.231276:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231284:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231290:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231312:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231325:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788509518.231334:0:15153:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788509518.231338:0:15153:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788509518.231375:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509518.231379:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231386:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226a00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509518.231390:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231397:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509518.231404:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509518.231409:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788509518.231411:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788509518.231413:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788509518.231427:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231432:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509518.231439:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231445:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226a00/0xe5156b86310dd3ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd3b3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509518.231453:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509518.231455:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509518.231457:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788509518.231476:0:15153:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788509518.231480:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788509518.231486:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788509518.231493:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:1.0:1788509518.231499:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8bcc87391000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788509518.231505:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8bcc86313800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788509518.231509:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8bcdbd199000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788509518.231514:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8bcdb47bb800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788509518.231522:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8bcdb786d800 e2b56a23-ddae-407e-b137-3c943d18cb4f 192.168.203.12@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788509518.231528:0:15153:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8bcd9e5db380) has exports, disconnecting them 00000020:00080000:1.0:1788509518.231533:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8bcc87391000), last request at 1788509518 00000020:00000080:1.0:1788509518.231542:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd75d 00000100:00080000:1.0:1788509518.231562:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcc87395800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788509518.231606:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788509518.231618:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcc87391000): rc 0 00000020:00000080:1.0:1788509518.231621:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcc87391000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788509518.231639:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8bcc86313800), last request at 1788509518 00000020:00000080:1.0:1788509518.231643:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd637 00000100:00080000:1.0:1788509518.231648:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcc86317000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788509518.231659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788509518.231666:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcc86313800): rc 0 00000020:00000080:1.0:1788509518.231668:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcc86313800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788509518.231671:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8bcdbd199000), last request at 1788509282 00000020:00000080:1.0:1788509518.231674:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd534 00000100:00080000:1.0:1788509518.231677:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcdbd19d800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788509518.231685:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788509518.231691:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcdbd199000): rc 0 00000020:00000080:1.0:1788509518.231698:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcdbd199000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788509518.231703:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8bcdb47bb800), last request at 1788509282 00000020:00000080:1.0:1788509518.231707:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd4f5 00000100:00080000:1.0:1788509518.231711:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbec1800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788509518.231723:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788509518.231730:0:15153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1788509518.231816:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcdb47bb800): rc 0 00000004:00000080:1.0:1788509518.231823:0:15153:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb93b4148fae0 00000100:00080000:1.0:1788509518.231843:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788509518.231847:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1788509518.234381:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796844288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509518.234464:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788509518.234601:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc87391000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788509518.234683:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86313800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788509518.234712:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd199000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788509518.234734:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc87395800 for lustre-MDT0000 00000020:00000080:0.0:1788509518.234739:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc86317000 for lustre-MDT0000 00000020:00000080:0.0:1788509518.234743:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdbd19d800 for lustre-MDT0000 00000100:00100000:3.0:1788509518.236762:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509518.236782:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796844672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509518.236853:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788509518.238179:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788509518.238226:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcdbd2e0000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788509518.239984:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796844288 00000100:00100000:2.0:1788509518.240000:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796844288 00000100:00100000:2.0:1788509518.240094:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796844672 00000100:00100000:2.0:1788509518.240098:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796844672 00000100:00100000:2.0:1788509518.240123:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788509518.240134:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+22:3645:x1875387796844288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788509518.240155:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509518.240179:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb590b200/0xe5156b86310dd901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd8fa expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509518.240198:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509518.240289:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+21:3645:x1875387796844288:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (5825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509518.240311:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788509518.240332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509518.240338:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89172c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+20:3645:x1875387796844672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788509518.240346:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509518.240355:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227400/0xe5156b86310dd3b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd3ac expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509518.240365:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509518.240387:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89172c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3645:x1875387796844672:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509518.240393:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509518.240471:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796844672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788509518.240494:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796844288:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788509518.240555:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788509518.240562:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788509518.240581:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788509518.240980:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788509518.241004:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcc8664a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788509518.241016:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788509518.241019:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788509518.241030:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788509518.241513:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788509518.241526:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcc870c9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788509518.243529:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509518.243564:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796844800:0@lo:39:umount.0 00000100:00100000:3.0:1788509518.243660:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509518.243703:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796844928:0@lo:9:umount.0 00000100:00100000:3.0:1788509518.243733:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509518.243752:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796845056:0@lo:9:umount.0 00000100:00100000:3.0:1788509518.243773:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509518.243813:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796844800 00000100:00100000:3.0:1788509518.243823:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796844800 00000100:00100000:3.0:1788509518.243877:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788509518.243886:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875387796844800:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788509518.243946:0:6526:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd59d 00000100:00080000:3.0:1788509518.243959:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8bcdbd2e6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788509518.243987:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788509518.244162:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3643:x1875387796844800:12345-0@lo:39:umount.0 Request processed in 276us (501us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788509518.244190:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788509518.244221:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796844928 00000100:00100000:3.0:1788509518.244226:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796844928 00000100:00100000:3.0:1788509518.244252:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796845056 00000100:00100000:3.0:1788509518.244256:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796845056 00000100:00100000:3.0:1788509518.244276:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788509518.244283:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875387796844928:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788509518.244315:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd6ed 00000100:00080000:3.0:1788509518.244322:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8bcc86314800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788509518.244369:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788509518.244481:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3643:x1875387796844928:12345-0@lo:9:umount.0 Request processed in 198us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.244488:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788509518.244502:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788509518.244509:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875387796845056:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788509518.244522:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd821 00000100:00080000:3.0:1788509518.244528:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8bcdb5972000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788509518.244549:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788509518.244625:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3643:x1875387796845056:12345-0@lo:9:umount.0 Request processed in 116us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509518.244631:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1788509518.244659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509518.244768:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788509518.244805:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbd2e0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788509518.244814:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796844800:0@lo:39:umount.0 00000100:00080000:3.0:1788509518.244827:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc8664a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788509518.244840:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788509518.244850:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788509518.244854:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796844928:0@lo:9:umount.0 00000100:00080000:3.0:1788509518.244867:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc870c9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788509518.244878:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788509518.244880:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788509518.244883:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796845056:0@lo:9:umount.0 00000020:00080000:1.0:1788509518.247147:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8bcd9e5db380) has no exports 00000020:00080000:1.0:1788509518.253830:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8bcd9e5db380) has no exports 00000020:00000080:1.0:1788509518.324613:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd407 00000020:00000080:1.0:1788509518.324629:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd9f605800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788509518.324644:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788509518.324732:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788509518.324751:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788509518.324756:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8bcdbbeccd40) has no exports 00000020:00000080:2.0:1788509518.324985:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd9f605800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788509518.325734:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd400 00000020:00000080:0.0:1788509518.325745:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcdbbec4800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788509518.327447:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbbec4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788509518.329316:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509518.329337:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788509518.329345:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcdbbec3800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788509518.329352:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbbec3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788509518.329359:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1788509518.550409:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509518.550443:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796845184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509518.550560:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509518.550937:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796845184 00000100:00100000:1.0:1788509518.550950:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796845184 00000100:00100000:1.0:1788509518.551046:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788509518.551058:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796845184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788509518.551103:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788509518.551186:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796845184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509518.551193:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788509518.551393:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796845184:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788509518.742478:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788509519.581063:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788509519.581077:0:8431:0:(genops.c:885:class_export_put()) final put ffff8bcc86311000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788509519.581101:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:3.0:1788509519.581104:0:8431:0:(genops.c:885:class_export_put()) final put ffff8bcc867ec000/d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:3.0:1788509519.581152:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86311000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788509519.581224:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc867ec000/d1c7a223-cc58-4f2c-be22-e37eba96eeae for lustre-OST0000 00000020:00000080:3.0:1788509519.581255:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc86314800 for lustre-OST0000 00000020:00000080:3.0:1788509519.581262:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc867ef800 for lustre-OST0000 00000001:00100000:2.0:1788509519.581630:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788509519.581635:0:9517:0:(genops.c:885:class_export_put()) final put ffff8bcdb5972800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788509519.581662:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:2.0:1788509519.581664:0:9517:0:(genops.c:885:class_export_put()) final put ffff8bcc87c81000/d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:3.0:1788509519.581792:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb5972800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788509519.581831:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc87c81000/d1c7a223-cc58-4f2c-be22-e37eba96eeae for lustre-OST0001 00000020:00000080:3.0:1788509519.581850:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb5972000 for lustre-OST0001 00000020:00000080:3.0:1788509519.581856:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc87c87000 for lustre-OST0001 00000001:00100000:0.0:1788509519.581937:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788509519.581954:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788509519.581959:0:7452:0:(genops.c:885:class_export_put()) final put ffff8bcdbd32d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788509519.581976:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e2b56a23-ddae-407e-b137-3c943d18cb4f 00000001:00080000:0.0:1788509519.581985:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788509519.581987:0:7452:0:(genops.c:885:class_export_put()) final put ffff8bcdb786b000/e2b56a23-ddae-407e-b137-3c943d18cb4f 00000020:00000080:2.0:1788509519.582009:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd32d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:0.0:1788509519.582016:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:2.0:1788509519.582376:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb786b000/e2b56a23-ddae-407e-b137-3c943d18cb4f for lustre-MDT0001 00000020:00000080:2.0:1788509519.582417:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdbd2e6800 for lustre-MDT0001 00000020:00000080:2.0:1788509519.582423:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb7869000 for lustre-MDT0001 00000001:00080000:0.0:1788509519.583122:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788509519.583130:0:7452:0:(genops.c:885:class_export_put()) final put ffff8bcc87396800/d1c7a223-cc58-4f2c-be22-e37eba96eeae 00000020:00000080:3.0:1788509519.585437:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc87396800/d1c7a223-cc58-4f2c-be22-e37eba96eeae for lustre-MDT0001 00000020:00000080:3.0:1788509519.585517:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb59c6800 for lustre-MDT0001 00010000:00010000:3.0:1788509519.767812:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509520.214660:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788509520.790239:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788509521.632358:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788509521.632368:0:6499:0:(genops.c:885:class_export_put()) final put ffff8bcdb47bb800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788509521.632407:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2b56a23-ddae-407e-b137-3c943d18cb4f 00000001:00080000:2.0:1788509521.632417:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788509521.632420:0:6499:0:(genops.c:885:class_export_put()) final put ffff8bcdb786d800/e2b56a23-ddae-407e-b137-3c943d18cb4f 00000020:00000080:3.0:1788509521.632539:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47bb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788509521.632616:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb786d800/e2b56a23-ddae-407e-b137-3c943d18cb4f for lustre-MDT0000 00000020:00000080:3.0:1788509521.632639:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdbbec1800 for lustre-MDT0000 00000020:00000080:3.0:1788509521.632644:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb786b800 for lustre-MDT0000 00010000:00010000:3.0:1788509521.814109:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509522.840508:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509523.158696:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509523.158718:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796845312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788509523.158796:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509523.159016:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796845312 00000100:00100000:2.0:1788509523.159025:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796845312 00000100:00100000:2.0:1788509523.159105:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788509523.159116:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796845312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788509523.159144:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788509523.159194:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796845312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509523.159201:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788509523.159374:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796845312:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788509523.161107:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509523.161236:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796845696:0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.161320:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509523.161364:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796846208:0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.161390:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509523.161414:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788509523.161420:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796845568:0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.161448:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509523.161470:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796846080:0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.161495:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509523.161525:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796845696 00000100:00100000:3.0:1788509523.161532:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796845696 00000100:00100000:3.0:1788509523.161568:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788509523.161575:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875387796845696:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788509523.161582:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788509523.161619:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875387796845696:12345-0@lo:400:kworker.0 Request processed in 43us (299us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788509523.161627:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788509523.161648:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796845568 00000100:00100000:3.0:1788509523.161652:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796845568 00000100:00100000:3.0:1788509523.161679:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788509523.161685:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3645:x1875387796845568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.161722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcda6379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3f21fff-d4b5-454c-a2da-1a3157f8f73e+19:3645:x1875387796845568:12345-0@lo:400:kworker.0 Request processed in 38us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509523.161729:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788509523.161755:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796846080 00000100:00100000:3.0:1788509523.161772:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796846080 00000100:00100000:3.0:1788509523.161809:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788509523.161816:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796846080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.161852:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796846080:12345-0@lo:400:kworker.0 Request processed in 38us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509523.161858:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:3.0:1788509523.161877:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509523.161890:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796846208 00000100:00100000:3.0:1788509523.161893:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796846208 00000100:00100000:3.0:1788509523.161949:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788509523.161955:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796846208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.161985:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796846208:12345-0@lo:400:kworker.0 Request processed in 30us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509523.161990:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788509523.162007:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509523.162046:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3645:1875387796845568:0@lo:400:kworker.0 00010000:00080000:3.0:1788509523.162059:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87dfce00 x1875387796846080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509523.162070:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796846080:0@lo:400:kworker.0 00000100:00080000:3.0:1788509523.162080:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788509523.162084:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8bcd91371000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788509523.162087:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788509523.162486:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796845824:0@lo:400:kworker.0 00000100:00100000:0.0:1788509523.162524:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509523.162560:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796846336:0@lo:400:kworker.0 00000100:00100000:0.0:1788509523.162581:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509523.162604:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788509523.162645:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796845824 00000100:00100000:2.0:1788509523.162651:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796845824 00000100:00100000:2.0:1788509523.162678:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796846336 00000100:00100000:2.0:1788509523.162680:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796846336 00000100:00100000:2.0:1788509523.162695:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788509523.162700:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875387796845824:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788509523.162718:0:9006:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788509523.162748:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875387796845824:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788509523.162754:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788509523.162767:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788509523.162771:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875387796846336:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788509523.162775:0:9006:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788509523.162792:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875387796846336:12345-0@lo:400:kworker.0 Request processed in 20us (211us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788509523.162797:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1788509523.197107:0:3646:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8bcc87781c00 x1875387796845440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509523.197142:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796845952:0@lo:400:kworker.0 00000100:00080000:3.0:1788509523.197144:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8bcd91371000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788509523.197154:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 179 00000100:00080000:3.0:1788509523.197163:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8bcd91371000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509523.197217:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd87c69880 x1875387796846592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509523.197227:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509523.197256:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796845696:0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.197288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796846592:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788509523.197491:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796845952 00000100:00100000:1.0:1788509523.197501:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796845952 00000100:00100000:1.0:1788509523.197544:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788509523.197551:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875387796845952:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788509523.197559:0:9006:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788509523.197593:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796846208:0@lo:400:kworker.0 00000100:00100000:1.0:1788509523.197596:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875387796845952:12345-0@lo:400:kworker.0 Request processed in 45us (375us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788509523.197602:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788509523.198160:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788509523.198166:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8bcc86312000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788509523.198169:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788509523.198174:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8bcc86312000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788509523.198179:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 199 00000100:00080000:0.0:1788509523.198186:0:3646:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8bcc86312000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509523.198208:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913d7b80 x1875387796846720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509523.198225:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796845952:0@lo:400:kworker.0 00000100:00100000:3.0:1788509523.198228:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509523.198238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796846464:0@lo:400:kworker.0 00000100:00100000:0.0:1788509523.198282:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509523.198285:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796846720:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788509523.198521:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788509523.198536:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbeef000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788509523.198540:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788509523.198543:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbeef000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788509523.198547:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 179 00000100:00080000:0.0:1788509523.198552:0:3646:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8bcdbbeef000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509523.198567:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913d7100 x1875387796846848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509523.198580:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796845824:0@lo:400:kworker.0 00000100:00080000:0.0:1788509523.198594:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788509523.198597:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8bcc87392800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788509523.198600:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788509523.198603:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8bcc87392800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788509523.198605:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 220 00000100:00080000:0.0:1788509523.198609:0:3646:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bcc87392800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509523.198620:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913d4e00 x1875387796846976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509523.198629:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796846336:0@lo:400:kworker.0 00000100:00100000:1.0:1788509523.198690:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796846464 00000100:00100000:1.0:1788509523.198696:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796846464 00000100:00100000:1.0:1788509523.198749:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788509523.198758:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796846464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509523.198803:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796846464:12345-0@lo:400:kworker.0 Request processed in 46us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509523.198810:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:0.0:1788509523.199423:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509523.199441:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788509523.199459:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787ce00 x1875387796846464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509523.199473:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796846464:0@lo:400:kworker.0 00000100:00100000:2.0:1788509523.199556:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796846592 00000100:00100000:2.0:1788509523.199563:0:10139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796846592 00000100:00100000:2.0:1788509523.199608:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788509523.199614:0:10139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875387796846592:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788509523.199630:0:10139:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788509523.199881:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875387796846848:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788509523.199939:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509523.204582:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796846976:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788509523.204651:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509523.204727:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796846720 00000100:00100000:1.0:1788509523.204753:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796846720 00000100:00100000:1.0:1788509523.204792:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796846848 00000100:00100000:1.0:1788509523.204796:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796846848 00000100:00100000:1.0:1788509523.204813:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788509523.204820:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796846720:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788509523.204837:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788509523.204883:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796846720:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 62us (5445us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788509523.204891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788509523.205201:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc86312000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509523.205207:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788509523.205211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796846720:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788509523.205503:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796846976 00000100:00100000:1.0:1788509523.205508:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796846976 00000100:00100000:1.0:1788509523.205524:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788509523.205529:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796846848:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788509523.205540:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788509523.205627:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796846848:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 96us (5687us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788509523.205634:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788509523.205650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788509523.205654:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796846976:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788509523.205663:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788509523.205691:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796846976:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35us (1040us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788509523.205697:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788509523.205762:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbeef000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509523.205767:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788509523.205770:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875387796846848:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788509523.205779:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc87392800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509523.205782:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788509523.205785:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796846976:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788509523.214156:0:10139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875387796846592:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 14527us (15918us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788509523.214176:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1788509523.214626:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd91371000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509523.214638:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788509523.214643:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796846592:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788509523.673695:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796847104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509523.673794:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509523.673879:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796847104 00000100:00100000:0.0:1788509523.673929:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796847104 00000100:00100000:0.0:1788509523.673996:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788509523.674007:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796847104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509523.674050:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788509523.674113:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796847104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509523.674121:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788509523.674439:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796847104:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788509523.862279:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788509524.375056:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcc8669ae40 - data ffff8bcdac6fc6c0/ffff8bcc876fe000 00000020:01000000:0.0:1788509524.375366:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcd890c43c0 - data ffff8bcdac4185e8/ffff8bcdb4504000 00000001:00000004:0.0:1788509524.391050:0:15153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788509524.466433:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788509524.466445:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788509524.466464:0:15153:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bcc87782300 x1875387796844800/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788509528 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509524.466494:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788509524.473182:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788509524.473194:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788509524.473264:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788509524.473281:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788509524.474195:0:8754:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788509524.474214:0:8754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788509524.474226:0:8754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788509524.476136:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788509524.476144:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788509524.476244:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788509524.476249:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788509524.476810:0:10062:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788509524.476817:0:10062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788509524.476833:0:10062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788509524.493751:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd3cf 00000020:00000080:1.0:1788509524.493779:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd913ef800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788509524.493830:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd913ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788509524.504158:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd3e4 00000020:00000080:1.0:1788509524.504179:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd9f602800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788509524.504206:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788509524.504218:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788509524.504230:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788509524.504235:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8bcd9e5dcd40) has no exports 00000020:00000080:2.0:1788509524.504271:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd9f602800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788509524.506234:0:15153:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788509524.506266:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd81a 00000020:00000080:1.0:1788509524.506278:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcdb5970800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788509524.506385:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788509524.506407:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788509524.506426:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788509524.506431:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8bcc870f0000) has no exports 00000020:00000080:1.0:1788509524.506443:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd813 00000020:00000080:1.0:1788509524.506448:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcc870ca800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788509524.506524:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb5970800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788509524.507353:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788509524.507360:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788509524.507365:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788509524.507374:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788509524.507376:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788509524.507502:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788509524.507518:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788509524.507525:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd6d8 00000020:00000080:1.0:1788509524.507533:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcdb59c7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788509524.507539:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788509524.507546:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788509524.507551:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788509524.507554:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8bcdb47c0000) has no exports 00000020:00000080:1.0:1788509524.507561:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd6d1 00000020:00000080:1.0:1788509524.507583:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd84a59800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788509524.508499:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc870ca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788509524.508515:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc870c9000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788509524.508522:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcdb7848000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788509524.508525:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb7848000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788509524.508530:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788509524.508824:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb59c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788509524.508830:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd84a59800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788509524.511830:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788509524.511840:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788509524.511846:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788509524.511855:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788509524.511858:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788509524.511953:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788509524.511968:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788509524.511991:0:15153:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788509524.511999:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd588 00000020:00000080:1.0:1788509524.512010:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcdbd32e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788509524.512017:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788509524.512028:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788509524.512034:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788509524.512038:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8bcdbd05b380) has no exports 00000020:00000080:1.0:1788509524.512048:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd581 00000020:00000080:1.0:1788509524.512053:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcdbd2e3800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788509524.512947:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc8664a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788509524.512963:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcdb59c0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788509524.512966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb59c0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788509524.512974:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788509524.513084:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd32e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788509524.513089:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd2e3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788509524.515003:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788509524.515013:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788509524.515017:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788509524.515028:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788509524.515094:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509524.515122:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788509524.515163:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509524.515166:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788509524.515173:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd913ee000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788509524.515179:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd913ee000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788509524.515191:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788509524.515335:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdbd2e0000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788509524.515347:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd3eb 00000020:00000080:2.0:1788509524.515355:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcdbd2e1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788509524.515357:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd9f600800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788509524.515360:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd2e1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788509524.515368:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788509524.515372:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788509524.515377:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788509524.515383:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788509524.515401:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8bcd9e5d8000) has no exports 00000020:00000080:0.0:1788509524.515431:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509524.515435:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788509524.515440:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd3f2 00000020:00000080:0.0:1788509524.515445:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd9f604800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788509524.515456:0:15153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcd82e88800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788509524.515460:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd82e88800 3 00000020:01000004:0.0:1788509524.515464:0:15153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bcd82e88800 from lustre-MDT0000 00000020:00000080:0.0:1788509524.515487:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509524.515490:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788509524.515493:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd913ea000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788509524.515496:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd913ea000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788509524.515504:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788509524.515538:0:15153:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788509524.515543:0:15153:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788509524.515546:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788509524.515549:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788509524.515551:0:15153:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788509524.515559:0:15153:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8bcd87671800 f3f21fff-d4b5-454c-a2da-1a3157f8f73e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788509524.515564:0:15153:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8bcdb0e23380) has exports, disconnecting them 00000020:00080000:0.0:1788509524.515569:0:15153:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8bcd87671800), last request at 1788509262 00000020:00000080:0.0:1788509524.515589:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd390 00000020:00010000:0.0:1788509524.515594:0:15153:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bcd87671800: total 2 00000100:00080000:0.0:1788509524.515598:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8bcd87676000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788509524.515619:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcd87671800): rc 0 00000020:00000080:2.0:1788509524.515621:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd9f600800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:0.0:1788509524.515624:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8bcdb0e23380) has no exports 00000020:00000080:2.0:1788509524.515627:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcd913eb000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788509524.515637:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd913eb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788509524.515642:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788509524.515842:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd9f604800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788509524.516032:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bcd87671800: total 0 00010000:00010000:3.0:1788509524.516080:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bcd87671800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788509524.516178:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9a00/0xe5156b86310dd8bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd8b4 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516197:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924800/0xe5156b86310dd8c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd8c2 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516209:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92925e00/0xe5156b86310dd8d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd8d0 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516221:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227c00/0xe5156b86310dd48c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd485 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516238:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924000/0xe5156b86310dd8e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd8de expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516262:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdc2072600/0xe5156b86310dd49a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd493 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516279:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227000/0xe5156b86310ddb23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310ddb1c expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516291:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310ddb31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310ddb2a expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516305:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9e00/0xe5156b86310ddb3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310ddb38 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516321:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92925800/0xe5156b86310dd8ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd8a6 expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516344:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8200/0xe5156b86310dd90f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd908 expref: 4 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516354:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcd92924a00/0xe5156b86310dd89f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd898 expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516369:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8c00/0xe5156b86310dd7b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe5156b86310dd7aa expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509524.516380:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bcd87671800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788509524.516396:0:6508:0:(genops.c:885:class_export_put()) final put ffff8bcd87671800/f3f21fff-d4b5-454c-a2da-1a3157f8f73e 00010000:00010000:3.0:1788509524.516534:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509524.516537:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509524.516539:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509524.516589:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8bcd82c77400:6513] 0 exiting: rc = 1 00000100:00100000:3.0:1788509524.516705:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8bcdaf872200:6514] 1 exiting: rc = 0 00000100:00100000:3.0:1788509524.516779:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8bcdaf872c00:6515] 2 exiting: rc = 0 00000100:00100000:0.0:1788509524.516972:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.516982:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.516990:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517008:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517014:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517020:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517035:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517041:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517048:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517055:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517062:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517068:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517075:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517080:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517086:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517092:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517099:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517105:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517113:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517127:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517133:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517139:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517144:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517151:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517158:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517165:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517172:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517178:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517186:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517192:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517199:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517207:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517212:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517219:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517225:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517231:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517236:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517242:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517247:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517265:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517271:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517288:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517295:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517301:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517308:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517314:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517320:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517327:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517332:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517338:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517345:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517351:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517356:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517360:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517366:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517372:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517378:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517384:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517389:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517394:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517400:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517406:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517411:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509524.517417:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788509524.518010:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd87671800/f3f21fff-d4b5-454c-a2da-1a3157f8f73e for MGS 00000020:00000080:2.0:1788509524.518061:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcd87676000 for MGS 00000020:01000000:2.0:1788509524.519879:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcc86535840 - data ffff8bcdac710948/ffff8bcdb5950800 00000020:01000000:2.0:1788509524.521854:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcd82c91d20 - data ffff8bcd89a82948/ffff8bcd892a1400 00000020:00000080:2.0:1788509524.522576:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd374 00000020:00000080:2.0:1788509524.522587:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd82e8b000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788509524.522616:0:15153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcd82e88800 from MGS, refs=2 00000020:01000004:2.0:1788509524.522621:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd82e88800 2 00000020:01000004:2.0:1788509524.522625:0:15153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bcd82e88800 from MGS 00000020:00000080:2.0:1788509524.522657:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509524.522666:0:15153:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788509524.522669:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd82e8c000/MGS 00000020:00000080:2.0:1788509524.522672:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd82e8c000/MGS for MGS 00000020:01000000:2.0:1788509524.522679:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788509524.522765:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788509524.522770:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788509524.522777:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788509524.522784:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8bcdbbf0b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788509524.522790:0:15153:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8bcdb0e219c0) has exports, disconnecting them 00000020:00080000:2.0:1788509524.522795:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8bcdbbf0b000), last request at 1788509263 00000020:00000080:2.0:1788509524.522800:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd43f 00000020:00080000:2.0:1788509524.522810:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcdbbf0b000): rc 0 00000020:00000080:2.0:1788509524.522817:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcdbbf0b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788509524.524137:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd82e8b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788509524.524154:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbbf0b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788509524.574570:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788509524.574582:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788509524.574587:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788509524.574597:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788509524.574932:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509524.575669:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788509524.575684:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd82e88800 1 00000020:00000080:2.0:1788509524.575693:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd366 00000020:00000080:2.0:1788509524.575704:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd82e8e000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788509524.575713:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788509524.575722:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788509524.575727:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788509524.575731:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8bcdb0e24d40) has no exports 00000020:00000080:0.0:1788509524.576128:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdbbf0c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788509524.576139:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcd853b8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788509524.576143:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd853b8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788509524.576157:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788509524.576284:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd82e8e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788509524.658976:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509524.658994:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788509524.659001:0:15153:0:(genops.c:885:class_export_put()) final put ffff8bcd82e8a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788509524.659031:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd82e8a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788509524.659043:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788509524.659200:0:15153:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8bcd82e89000 00000020:02000400:0.0:1788509524.659292:0:15153:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788509524.885987:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509525.911132:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509526.936704:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509527.965469:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788509528.278378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509528.278385:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788509528.278389:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcd91371000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509528.278398:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 420 00000100:00080000:1.0:1788509528.278404:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788509528.278411:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8bcd91371000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509528.278435:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87780000 x1875387796847488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509528.278453:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509528.278457:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788509528.278458:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbeef000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509528.278462:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 420 00000100:00080000:1.0:1788509528.278478:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788509528.278481:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8bcdbbeef000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509528.278495:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87783b80 x1875387796847616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509528.278504:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509528.278507:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788509528.278522:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcc86312000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509528.278525:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 420 00000100:00080000:1.0:1788509528.278528:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788509528.278532:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8bcc86312000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509528.278543:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87781180 x1875387796847744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509528.278577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509528.278580:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788509528.278581:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcc87392800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509528.278585:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 420 00000100:00080000:1.0:1788509528.278587:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788509528.278589:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bcc87392800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509528.278600:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87354700 x1875387796848128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788509528.278639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796848000:0@lo:400:kworker.0 00000100:00100000:1.0:1788509528.278707:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509528.278772:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509528.278779:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796847872:0@lo:400:kworker.0 00000100:00100000:1.0:1788509528.278812:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.278959:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796848256:0@lo:400:kworker.0 00000100:00100000:0.0:1788509528.278990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.279020:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788509528.279027:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796847360:0@lo:400:kworker.0 00000400:00000100:0.0:1788509528.279046:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875387796847360 offset 0 length 224: 4 00000100:00100000:0.0:1788509528.279061:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796848384:0@lo:400:kworker.0 00000100:00100000:0.0:1788509528.279080:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.279118:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796847872 00000100:00100000:0.0:1788509528.279125:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796847872 00000100:00100000:0.0:1788509528.279191:0:9006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796848256 00000100:00100000:0.0:1788509528.279195:0:9006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796848256 00000100:00100000:0.0:1788509528.279219:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788509528.279238:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796847872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509528.279286:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796847872:12345-0@lo:400:kworker.0 Request processed in 59us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509528.279293:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788509528.279310:0:9006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788509528.279315:0:9006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796848256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509528.279344:0:9006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875387796848256:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509528.279350:0:9006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788509528.279369:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796848000 00000100:00100000:0.0:1788509528.279372:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796848000 00000100:00100000:0.0:1788509528.279406:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796848384 00000100:00100000:0.0:1788509528.279409:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796848384 00000100:00100000:0.0:1788509528.279428:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788509528.279435:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796848000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509528.279465:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796848000:12345-0@lo:400:kworker.0 Request processed in 31us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509528.279471:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788509528.279481:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788509528.279487:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796848384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509528.279524:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796848384:12345-0@lo:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509528.279529:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1788509528.279544:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509528.279548:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509528.279550:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509528.279592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796848384:0@lo:400:kworker.0 00010000:00080000:0.0:1788509528.279604:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8bcc87357100 x1875387796848256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509528.279613:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796848256:0@lo:400:kworker.0 00010000:00080000:0.0:1788509528.279643:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8bcc87780a80 x1875387796847872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509528.279650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796847872:0@lo:400:kworker.0 00000100:00100000:0.0:1788509528.279660:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796848000:0@lo:400:kworker.0 00000100:00100000:0.0:1788509528.279700:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796847488:0@lo:38:kworker.0 00000100:00100000:0.0:1788509528.279728:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.279755:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875387796847616:0@lo:38:kworker.0 00000100:00100000:0.0:1788509528.279776:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.279791:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796847744:0@lo:38:kworker.0 00000100:00100000:0.0:1788509528.279809:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.279823:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796848128:0@lo:38:kworker.0 00000100:00100000:0.0:1788509528.279843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.279868:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796847488 00000100:00100000:0.0:1788509528.279871:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796847488 00000100:00100000:0.0:1788509528.279891:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788509528.279922:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875387796847488:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788509528.279940:0:6526:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788509528.279973:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875387796847488:12345-0@lo:38:kworker.0 Request processed in 77us (245us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788509528.279979:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788509528.279997:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796847616 00000100:00100000:0.0:1788509528.280000:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796847616 00000100:00100000:0.0:1788509528.280011:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796847744 00000100:00100000:0.0:1788509528.280013:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796847744 00000100:00100000:0.0:1788509528.280020:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796848128 00000100:00100000:0.0:1788509528.280022:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796848128 00000100:00100000:0.0:1788509528.280031:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788509528.280035:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796847616:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788509528.280044:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788509528.280069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796847616:12345-0@lo:38:kworker.0 Request processed in 33us (292us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788509528.280075:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788509528.280087:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788509528.280098:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796847744:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788509528.280108:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788509528.280134:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796847744:12345-0@lo:38:kworker.0 Request processed in 35us (324us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788509528.280140:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788509528.280152:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788509528.280156:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796848128:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788509528.280165:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788509528.280187:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796848128:12345-0@lo:38:kworker.0 Request processed in 31us (344us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788509528.280193:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1788509528.280221:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd91371000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509528.280238:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788509528.280241:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796847488:0@lo:38:kworker.0 00000100:00080000:0.0:1788509528.280250:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbeef000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509528.280254:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788509528.280256:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875387796847616:0@lo:38:kworker.0 00000100:00080000:0.0:1788509528.280263:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc86312000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509528.280265:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788509528.280267:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796847744:0@lo:38:kworker.0 00000100:00080000:0.0:1788509528.280273:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc87392800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509528.280276:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788509528.280278:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796848128:0@lo:38:kworker.0 00000100:00100000:3.0:1788509528.280666:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788509528.280677:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796847232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509528.280712:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509528.280744:0:9005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796847232 00000100:00100000:3.0:1788509528.280748:0:9005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796847232 00000100:00100000:3.0:1788509528.280778:0:9005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788509528.280785:0:9005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796847232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509528.280816:0:9005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788509528.280853:0:9005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796847232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509528.280859:0:9005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788509528.280894:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796847232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509528.797453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796848512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509528.797530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.797713:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796848512 00000100:00100000:0.0:1788509528.797732:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796848512 00000100:00100000:0.0:1788509528.797793:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788509528.797803:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796848512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509528.797831:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788509528.797879:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796848512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509528.797888:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788509528.798128:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796848512:0@lo:13:osp-pre-0-1.0 00000020:01000004:1.0:1788509528.920668:0:15354:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788509528.944057:0:15354:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788509528.944108:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.944122:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.947014:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.947024:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.947117:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788509528.947134:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788509528.947175:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788509528.947180:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788509528.947186:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788509528.947192:0:15354:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbeef000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788509528.947216:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788509528.947228:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788509528.947232:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788509528.948575:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.948591:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.948598:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.948604:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952287:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788509528.952301:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952314:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226800 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509528.952318:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952330:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788509528.952339:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509528.952345:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788509528.952348:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788509528.952351:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788509528.952392:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952416:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509528.952449:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952457:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226800/0xe5156b86310dd8d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952472:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509528.952476:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952482:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509528.952486:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952494:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509528.952500:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796848640:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1788509528.952503:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509528.952513:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788509528.952515:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788509528.952528:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952534:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509528.952540:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509528.952556:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509528.952558:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509528.952560:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509528.952586:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509528.952646:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509528.952654:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796848768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509528.952678:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509528.952714:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796848640 00000100:00100000:1.0:1788509528.952723:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796848640 00000100:00100000:1.0:1788509528.952760:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796848768 00000100:00100000:1.0:1788509528.952763:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796848768 00000100:00100000:1.0:1788509528.952779:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788509528.952792:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1875387796848640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788509528.952798:0:7472:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788509528 with bad export cookie 16507218233289200528 00000100:00100000:3.0:1788509528.952815:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509528.952823:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3644:x1875387796848768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788509528.952830:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788509528 with bad export cookie 16507218233289200528 00000100:00100000:3.0:1788509528.952878:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3644:x1875387796848768:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (200us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788509528.952885:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788509528.952957:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788509528.952962:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8bcd836cb800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788509528.952966:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788509528.953178:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788509528.953187:0:15354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310dd8de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd8e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953201:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953209:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953215:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953233:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953248:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788509528.953253:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953268:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953274:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953280:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953287:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788509528.953292:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953299:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953318:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953324:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.953331:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788509528.953334:0:15354:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788509528.953337:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788509528.953376:0:15354:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788509528.953380:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788509528.953385:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788509528.953391:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788509528.953403:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8bcc86045000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788509528.953409:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8bcdb47bf000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788509528.953413:0:15354:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8bcdb47c19c0) has exports, disconnecting them 00000020:00080000:2.0:1788509528.953417:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8bcc86045000), last request at 1788509528 00000020:00000080:2.0:1788509528.953425:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd772 00000100:00080000:2.0:1788509528.953442:0:15354:0:(import.c:65:import_set_state_nolock()) ffff8bcc86041800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788509528.953485:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcc86045000): rc 0 00000020:00000080:2.0:1788509528.953487:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcc86045000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788509528.953498:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8bcdb47bf000), last request at 1788509528 00000020:00000080:2.0:1788509528.953501:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd64c 00000100:00080000:2.0:1788509528.953507:0:15354:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47bf800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788509528.953513:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcdb47bf000): rc 0 00000020:00000080:2.0:1788509528.953515:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdb47bf000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788509528.953522:0:15354:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb93b41cb7ae0 00000100:00080000:2.0:1788509528.953539:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788509528.953546:0:15354:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8bcc87781c00 x1875387796845440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509528.953561:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1788509528.953600:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788509528.953606:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509528.953614:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509528.953618:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509528.953627:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509528.953634:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509528.953639:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788509528.953642:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788509528.953644:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:2.0:1788509528.954373:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788509528.954379:0:15354:0:(import.c:65:import_set_state_nolock()) ffff8bcd91371000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788509528.955677:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:2.0:1788509528.962485:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86045000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788509528.962560:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47bf000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788509528.962586:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc86041800 for lustre-MDT0001 00000020:00000080:2.0:1788509528.962590:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdb47bf800 for lustre-MDT0001 00000100:00100000:1.0:1788509528.965551:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:0:1875387796845440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509528.965757:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1875387796848640:12345-0@lo:103:ldlm_bl.0 Request processed in 12968us (13169us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788509528.965767:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788509528.978025:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788509528.978032:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788509528.978065:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788509528.978122:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788509528.978149:0:15354:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788509528.978166:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788509528.978168:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788509528.978176:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788509528.978238:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788509528.978250:0:15354:0:(import.c:65:import_set_state_nolock()) ffff8bcc870ce800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788509528.978282:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8bcdb47c19c0) has no exports 00010000:00010000:2.0:1788509528.978759:0:15355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788509528.979153:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796848896:0@lo:9:umount.0 00000100:00100000:2.0:1788509528.979237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509528.979279:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796849024:0@lo:9:umount.0 00000100:00100000:2.0:1788509528.979303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509528.983700:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509528.983715:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8a00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509528.983719:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509528.983729:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509528.983737:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509528.983742:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788509528.983745:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788509528.983748:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788509528.983874:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509528.983882:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.983889:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdc2073800 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509528.983891:0:15355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.983913:0:15355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509528.983919:0:15355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509528.983924:0:15355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788509528.983932:0:15355:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788509528.983934:0:15355:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:3.0:1788509528.985022:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788509528.985026:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788509528.985035:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcc87782680 x1875387796847360/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788509544 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509528.985048:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcd87c68380 x1875387796848640/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788509544 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509528.985057:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcd87c68700 x1875387796848768/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788509544 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788509528.985066:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788509528.985069:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788509528.985070:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788509528.985404:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796848896 00000100:00100000:0.0:1788509528.985412:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796848896 00000100:00100000:0.0:1788509528.985459:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796849024 00000100:00100000:0.0:1788509528.985462:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796849024 00000100:00100000:0.0:1788509528.985482:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788509528.985491:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875387796848896:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788509528.985515:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd6a7 00000100:00080000:0.0:1788509528.985524:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcc86310800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788509528.985634:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788509528.985816:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3643:x1875387796848896:12345-0@lo:9:umount.0 Request processed in 325us (6579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509528.985823:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788509528.985836:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788509528.985842:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875387796849024:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788509528.985853:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd7e2 00000100:00080000:0.0:1788509528.985858:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8bcdbd329000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788509528.985874:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788509528.985973:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3643:x1875387796849024:12345-0@lo:9:umount.0 Request processed in 131us (6669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509528.985979:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788509528.986028:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788509528.986039:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788509528.986041:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788509528.986045:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796848896:0@lo:9:umount.0 00000100:00080000:0.0:1788509528.986055:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc870ce800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788509528.986063:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788509528.986064:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788509528.986066:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796849024:0@lo:9:umount.0 00010000:00010000:0.0:1788509528.986231:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509528.986240:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509528.986391:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509528.986400:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92924600/0xe5156b86310dd7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509528.986428:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:0:1875387796849152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509528.986443:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509528.986445:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509528.986448:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509528.986508:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509528.986516:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788509528.986563:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788509528.986636:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509528.986644:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310ddb38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310ddb3f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509528.986653:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509528.986655:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509528.986656:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509528.986881:0:15355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.986888:0:15355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788509528.986924:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.986931:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdc2073800/0xe5156b86310dd493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe5156b86310dd49a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509528.986943:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509528.986945:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509528.986947:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509528.986951:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509528.986954:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509528.986996:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509528.987006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:0:1875387796849408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509528.987060:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:0:1875387796849280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509528.987072:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788509528.987106:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8bcd836cb800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788509528.987112:0:3644:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 159 00000100:00080000:3.0:1788509528.987119:0:3644:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff8bcd836cb800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509528.987214:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb787d880 x1875387796849536/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509528.987336:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3643:1875387796849536:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788509528.987378:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875387796849536 offset 0 length 520: 4 00000100:00100000:2.0:1788509528.987440:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796848640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788509528.987448:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796847360:0@lo:400:kworker.0 00000100:00100000:2.0:1788509528.987464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3644:1875387796848768:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788509528.993455:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8bcdb47c19c0) has no exports 00000020:01000000:3.0:1788509529.105340:0:15354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcc87534c60 - data ffff8bcdac70f948/ffff8bcdb5c59800 00000020:01000000:3.0:1788509529.105542:0:15354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcdb58790c0 - data ffff8bcdac583360/ffff8bcdbd39f400 00000001:00000004:3.0:1788509529.130438:0:15354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788509529.193342:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788509529.193355:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788509529.193367:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788509529.200583:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788509529.200594:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788509529.200638:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788509529.200641:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788509529.201543:0:8750:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788509529.201550:0:8750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788509529.201562:0:8750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788509529.202300:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788509529.202306:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788509529.202323:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788509529.202326:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788509529.203255:0:10058:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788509529.203262:0:10058:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788509529.203279:0:10058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788509529.209506:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd4b6 00000020:00000080:3.0:1788509529.209522:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdb47ba000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788509529.213063:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47ba000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788509529.217177:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd4cb 00000020:00000080:3.0:1788509529.217195:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdb47cc800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788509529.217335:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788509529.217342:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788509529.217407:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788509529.217413:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8bcdbbecb380) has no exports 00000004:01000000:3.0:1788509529.217661:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788509529.217672:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd7d4 00000020:00000080:3.0:1788509529.217677:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdb7849800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788509529.218051:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47cc800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788509529.218164:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788509529.218170:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788509529.218181:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788509529.218185:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8bcc863019c0) has no exports 00000020:00000080:3.0:1788509529.218194:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd7cd 00000020:00000080:3.0:1788509529.218199:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcc870ce000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788509529.218451:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb7849800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788509529.218461:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc870ce000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788509529.218838:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788509529.218843:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788509529.218849:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788509529.218855:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788509529.218858:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788509529.219014:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788509529.219026:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788509529.219034:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd692 00000020:00000080:3.0:1788509529.219055:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcc86316800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788509529.219759:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc870ce800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788509529.219773:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcc870c8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788509529.219775:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc870c8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788509529.219783:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788509529.220034:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788509529.220041:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788509529.220052:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788509529.220057:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8bcdbbec8000) has no exports 00000020:00000080:3.0:1788509529.220065:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd68b 00000020:00000080:3.0:1788509529.220071:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcc810b1800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788509529.220483:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788509529.220488:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788509529.220493:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788509529.220499:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788509529.220501:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788509529.220535:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788509529.220543:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788509529.220746:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788509529.220755:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd4ee 00000020:00000080:3.0:1788509529.220762:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdb47cb000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788509529.220767:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788509529.220772:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788509529.220777:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788509529.220780:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8bcdbd05cd40) has no exports 00000020:00000080:3.0:1788509529.220785:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd4e7 00000020:00000080:3.0:1788509529.220789:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcd91373000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788509529.221069:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86316800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788509529.221080:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc810b1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788509529.221086:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc810b6000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788509529.221093:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcdbd328000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788509529.221096:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd328000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788509529.221100:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788509529.221173:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47cb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788509529.221178:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd91373000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788509529.223972:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788509529.223985:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788509529.223991:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788509529.224011:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788509529.224092:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509529.224108:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788509529.224155:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509529.224159:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788509529.224166:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdbbee8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788509529.224171:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbbee8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788509529.224181:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788509529.224407:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd4d2 00000020:00000080:2.0:1788509529.224417:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdb47cd000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788509529.224423:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788509529.224427:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788509529.224433:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788509529.224437:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8bcdb47c4d40) has no exports 00000020:00000080:2.0:1788509529.224463:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509529.224467:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788509529.224470:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd4d9 00000020:00000080:2.0:1788509529.224475:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdb47ce000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788509529.224484:0:15354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcdbbf0f800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788509529.224487:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcdbbf0f800 2 00000020:01000004:2.0:1788509529.224491:0:15354:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bcdbbf0f800 from lustre-MDT0001 00000020:00000080:2.0:1788509529.224513:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509529.224516:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788509529.224519:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcd8913d800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788509529.224521:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd8913d800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788509529.224528:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788509529.224571:0:15354:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788509529.224576:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788509529.224580:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788509529.224583:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788509529.224591:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8bcdb47ce800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788509529.224597:0:15354:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8bcdb47c3380) has exports, disconnecting them 00000020:00080000:2.0:1788509529.224601:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8bcdb47ce800), last request at 1788509282 00000020:00000080:2.0:1788509529.224605:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd52d 00000020:00080000:2.0:1788509529.224629:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcdb47ce800): rc 0 00000020:00000080:2.0:1788509529.224633:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdb47ce800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788509529.225424:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcd91371000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788509529.225437:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcd913e9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788509529.225439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd913e9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788509529.225450:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788509529.225587:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47cd000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788509529.225592:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcd84a5b800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788509529.225594:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd84a5b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788509529.225598:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788509529.225780:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47ce000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788509529.225786:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47ce800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788509529.262983:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788509529.263004:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788509529.263009:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788509529.263018:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788509529.263284:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788509529.263296:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788509529.263317:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcdbbf0f800 1 00000020:00000080:3.0:1788509529.263326:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd469 00000020:00000080:3.0:1788509529.263338:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcd82e6c800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788509529.265586:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdbbeef000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788509529.265611:0:37:0:(genops.c:885:class_export_put()) final put ffff8bcdb47cb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788509529.265638:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb47cb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788509529.265658:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1788509529.266203:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788509529.266213:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788509529.266232:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788509529.266238:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8bcdb4623380) has no exports 00000020:00000080:1.0:1788509529.266378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd82e6c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788509529.396530:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509529.396550:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788509529.396558:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcdbbf0e800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788509529.396564:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbbf0e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788509529.396577:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788509529.396717:0:15354:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8bcdbbf09800 00000020:01000000:2.0:1788509529.396741:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788509529.396746:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788509529.396752:0:15354:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788509529.396757:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8bcdb0e20000) has no exports 00000100:00100000:0.0:1788509529.396934:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8bcdb1224000:6521] 1 exiting: rc = 0 00000100:00100000:0.0:1788509529.397091:0:9006:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8bcc86454a00:9006] 3 exiting: rc = 0 00000100:00100000:1.0:1788509529.397733:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8bcdb1224800:6520] 0 exiting: rc = 1 00000100:00100000:1.0:1788509529.397848:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8bcd833b1400:6522] 2 exiting: rc = 0 00000100:00100000:2.0:1788509529.405636:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405650:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405656:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405665:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405672:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405678:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405685:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405690:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405696:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405703:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405710:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405716:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405723:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405729:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405739:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405746:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405753:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405758:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405763:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405770:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405780:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405787:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405818:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405823:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405829:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405834:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405841:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405848:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405855:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405860:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405866:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405871:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405877:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405883:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405889:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405938:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405946:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405953:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405959:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405965:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405971:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405978:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405984:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405990:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.405996:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406002:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406008:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406014:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406020:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406026:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406032:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406039:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406045:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406050:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406057:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406062:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406069:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406084:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406089:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406095:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406101:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406108:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406114:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.406128:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.421425:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8bcd833b1a00:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1788509529.421535:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8bcd8378c000:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1788509529.427395:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427407:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427415:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427423:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427430:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427437:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427445:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427452:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427458:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427465:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427471:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427479:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427487:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427493:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427500:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427506:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427513:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427519:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427525:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427531:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427537:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427543:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.427548:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.429850:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.429866:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.429872:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.429878:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.429883:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.430744:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.430752:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.430760:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.430769:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432419:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432444:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432450:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432455:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432460:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432466:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432472:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432478:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432483:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432488:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432494:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432500:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432507:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432514:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432519:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432525:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432531:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432536:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432542:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432548:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432566:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432572:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432577:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432582:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432588:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432593:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432599:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432604:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432610:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432615:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432620:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.432658:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788509529.440683:0:10139:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8bcdaf81fe00:10139] 2 exiting: rc = 0 00000100:00100000:0.0:1788509529.440683:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8bcd89db3a00:6526] 1 exiting: rc = 0 00000100:00100000:2.0:1788509529.440820:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8bcd89dfde00:6525] 0 exiting: rc = 1 00000100:00100000:2.0:1788509529.443229:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443244:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443254:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443279:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443286:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443293:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443300:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443307:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443314:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443331:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443339:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443347:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443567:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443576:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443583:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443606:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443614:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443622:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443629:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443636:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443642:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443649:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443656:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443663:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443669:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443675:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443682:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443704:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443711:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443717:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443724:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443730:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443738:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443762:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.443769:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444176:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444186:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444202:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444209:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444241:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444250:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444257:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444263:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444270:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444277:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444283:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444289:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444296:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444302:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444308:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.444315:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.446883:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.447289:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.447297:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.447305:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.447312:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.448725:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.448754:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.448761:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.448769:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.448777:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.448784:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.448793:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509529.448802:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788509529.473199:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8bcd83f85800:6528] 1 exiting: rc = 0 00000100:00100000:2.0:1788509529.473386:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8bcd89db3c00:6527] 0 exiting: rc = 1 00000100:00100000:0.0:1788509529.473486:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473495:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473501:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473508:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473513:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473540:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473546:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473563:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473570:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473576:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473581:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473586:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473591:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473596:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473602:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473607:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473613:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473619:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473625:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473630:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473636:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473642:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473648:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473654:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473659:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473664:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473669:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473674:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473680:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473685:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473691:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473697:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473702:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473708:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473714:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473720:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473725:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473730:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473736:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473741:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473755:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473761:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473767:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473773:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473778:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473784:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473790:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473796:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473801:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473807:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473812:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473818:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473824:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473829:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473835:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473840:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473846:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473851:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473856:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473862:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473867:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473872:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473879:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.473884:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.476584:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8bcd83f85e00:6529] 0 exiting: rc = 1 00000100:00100000:0.0:1788509529.480815:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8bcd83f85600:6530] 1 exiting: rc = 0 00000100:00100000:1.0:1788509529.481092:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481102:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481108:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481114:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481120:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481126:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481132:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481138:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481145:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481151:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481157:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481162:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481168:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481173:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481178:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481183:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481200:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481207:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481213:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481226:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481232:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481237:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481244:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481249:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481254:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481259:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481264:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481297:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481304:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481309:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481315:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481320:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481325:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481331:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481337:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481343:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481349:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481354:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481360:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481366:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481372:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481378:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481384:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481390:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481395:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481401:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481406:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481412:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481417:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481422:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481428:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481433:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481438:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481444:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481449:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481455:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481460:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481465:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481471:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481477:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481482:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481487:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481502:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.481508:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.482363:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8bcd83f84400:6531] 0 exiting: rc = 1 00000100:00100000:0.0:1788509529.482467:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8bcd83f84a00:6532] 1 exiting: rc = 0 00000100:00100000:1.0:1788509529.483036:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483044:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483050:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483055:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483062:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483068:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483074:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483079:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483086:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483091:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483096:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483102:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483108:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483114:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483120:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483125:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483130:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483136:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483141:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483146:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483151:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483156:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483161:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483166:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483171:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483176:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483181:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483186:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483198:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483203:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483208:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483213:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483225:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483242:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483248:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483254:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483260:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483266:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483272:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483277:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483282:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483287:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483292:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483297:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483302:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483308:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483313:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483326:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483332:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483337:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483342:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483347:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483351:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483357:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483362:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483368:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483373:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483378:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483383:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483388:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483393:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483399:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483405:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.483411:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509529.484842:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8bcd83f85a00:6533] 0 exiting: rc = 1 00000100:00100000:3.0:1788509529.485845:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8bcd89dfdc00:6534] 1 exiting: rc = 0 00000100:00100000:3.0:1788509529.486225:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8bcd83f84800:6535] 2 exiting: rc = 0 00000100:00100000:1.0:1788509529.486872:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486882:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486925:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486933:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486952:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486959:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486965:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486972:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486978:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.486984:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487000:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487006:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487012:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487018:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487025:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487031:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487037:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487043:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487049:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487055:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487061:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487066:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487072:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487078:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487083:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487090:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487108:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487115:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487121:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487127:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487133:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487139:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487144:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487150:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487157:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487164:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487170:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487177:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487183:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487202:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487208:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487223:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487232:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487237:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487244:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487250:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487257:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487263:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487269:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487275:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487292:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487299:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487304:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487310:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487316:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487329:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487335:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487341:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487347:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487353:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487359:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487365:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487371:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509529.487376:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788509529.501259:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509529.501279:0:15354:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788509529.501287:0:15354:0:(genops.c:885:class_export_put()) final put ffff8bcd83145000/MDS_uuid 00000020:00000080:2.0:1788509529.501305:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd83145000/MDS_uuid for MDS 00000020:01000000:2.0:1788509529.501328:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788509529.501518:0:15354:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788509530.006067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509531.033279:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509532.054151:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509533.090022:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788509533.399337:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788509533.399347:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509533.399350:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788509533.399353:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788509533.399357:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcc86312000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509533.399367:0:485:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1788509533.399372:0:485:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788509533.399378:0:485:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8bcc86312000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509533.399428:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb787fb80 x1875387796849664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788509533.399478:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788509533.399482:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788509533.399484:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcc87392800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509533.399488:0:485:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1788509533.399491:0:485:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788509533.399495:0:485:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bcc87392800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509533.399507:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb787e680 x1875387796849920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509533.399551:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788509533.399568:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796849792:0@lo:400:kworker.0 00000400:00000100:2.0:1788509533.399619:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796849792 offset 0 length 224: 4 00000100:00100000:2.0:1788509533.399700:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509533.399710:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796850048:0@lo:400:kworker.0 00000400:00000100:2.0:1788509533.399733:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796850048 offset 0 length 224: 4 00000100:00100000:0.0:1788509533.400117:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796849664:0@lo:38:kworker.0 00000400:00000100:0.0:1788509533.400147:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796849664 offset 0 length 520: 4 00000100:00100000:0.0:1788509533.400168:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796849920:0@lo:38:kworker.0 00000400:00000100:0.0:1788509533.400211:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796849920 offset 0 length 520: 4 00000020:01000004:1.0:1788509533.726174:0:15557:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788509533.739483:0:15557:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788509533.739551:0:15557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509533.739568:0:15557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509533.739577:0:15557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509533.739598:0:15557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509533.739622:0:15557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788509533.739628:0:15557:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788509533.739758:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509533.739765:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509533.739774:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925200 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509533.739777:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509533.739785:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509533.739792:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509533.739797:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788509533.739799:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788509533.739801:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788509533.739824:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bcd836cb800 00010000:00010000:2.0:1788509533.739828:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509533.739835:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92925200/0xe5156b86310dd8b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd8bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509533.739846:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509533.739848:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509533.739850:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788509533.742623:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788509533.742656:0:15557:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcdb787fb80 x1875387796849664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788509553 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509533.742732:0:15557:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788509533.742748:0:15557:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788509533.742755:0:15557:0:(import.c:65:import_set_state_nolock()) ffff8bcc86312000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788509533.742761:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788509533.742766:0:15557:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcdb787fb80 x1875387796849664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788509553 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509533.747473:0:15557:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788509533.747486:0:15557:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788509533.747490:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796849664:0@lo:38:kworker.0 00000100:00080000:1.0:1788509533.752608:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788509533.752626:0:15557:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcdb787ca80 x1875387796849792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509549 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509533.752745:0:15557:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788509533.752752:0:15557:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788509533.752778:0:15557:0:(import.c:65:import_set_state_nolock()) ffff8bcc86311800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788509533.755178:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875387796850176:0@lo:39:umount.0 00000400:00000100:0.0:1788509533.755252:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796850176 offset 0 length 224: 4 00000100:00100000:2.0:1788509533.755524:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796849792:0@lo:400:kworker.0 00010000:00010000:3.0:1788509534.102342:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788509534.422297:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509534.422315:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509534.422318:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509534.422335:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788509534.422574:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796850304:0@lo:400:kworker.0 00000400:00000100:2.0:1788509534.422631:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796850304 offset 0 length 224: 4 00000001:00100000:2.0:1788509534.938063:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788509534.938076:0:9517:0:(genops.c:885:class_export_put()) final put ffff8bcdbd328800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788509534.938187:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd328800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000001:00100000:3.0:1788509534.938351:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788509534.938357:0:8431:0:(genops.c:885:class_export_put()) final put ffff8bcc86314000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788509534.939886:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcdbd329000 for lustre-OST0001 00000020:00000080:0.0:1788509534.940192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86314000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788509534.940241:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc86310800 for lustre-OST0000 00010000:00010000:2.0:1788509535.126251:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509536.150182:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509537.174749:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509538.198853:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788509538.454055:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509538.454069:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509538.454072:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509538.454076:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788509538.454746:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796850432:0@lo:400:kworker.0 00000400:00000100:3.0:1788509538.454822:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796850432 offset 0 length 224: 4 00000100:00100000:0.0:1788509538.902287:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509528/real 1788509528] req@ffff8bcdb787d880 x1875387796849536/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788509538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509538.902331:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcdb787d880 x1875387796849536/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788509538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788509538.902359:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd836cb800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509538.902391:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788509538.902880:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3643:1875387796849536:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1788509538.903037:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509538.903044:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788509538.903048:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcd836cb800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509538.903054:0:485:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 426 00000100:00080000:1.0:1788509538.903060:0:485:0:(import.c:630:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788509538.903068:0:485:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff8bcd836cb800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509538.903113:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87355c00 x1875387796850560/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509538.903148:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509538.903161:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788509538.903289:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509538.903310:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796850688:0@lo:400:kworker.0 00000400:00000100:3.0:1788509538.903377:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796850688 offset 0 length 224: 4 00000100:00100000:0.0:1788509538.903687:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3643:1875387796850560:0@lo:250:kworker.0 00000400:00000100:0.0:1788509538.903715:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875387796850560 offset 0 length 520: 4 00010000:00010000:2.0:1788509539.224639:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509540.247822:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509541.270756:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509542.294218:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509543.318212:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509544.022074:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509533/real 1788509533] req@ffff8bcc87354000 x1875387796850176/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788509543 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509544.022113:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87354000 x1875387796850176/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788509543 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788509544.022185:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc86311800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788509544.022706:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875387796850176:0@lo:39:umount.0 00000100:00080000:1.0:1788509544.022852:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788509544.022858:0:15557:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788509544.022864:0:15557:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788509544.024064:0:15557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509544.024083:0:15557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509544.024090:0:15557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509544.024110:0:15557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509544.024148:0:15557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788509544.024157:0:15557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509544.024164:0:15557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509544.024170:0:15557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509544.024177:0:15557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509544.024769:0:15557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788509544.024778:0:15557:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788509544.024813:0:15557:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788509544.024819:0:15557:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788509544.024826:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788509544.024833:0:15557:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788509544.024838:0:15557:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8bcdbd0599c0) has no exports 00000020:00080000:1.0:1788509544.024870:0:15557:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8bcdbd0599c0) has no exports 00000020:01000000:1.0:1788509544.026727:0:15557:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcc8721a1e0 - data ffff8bcdac673798/ffff8bcdb785c000 00000020:01000000:1.0:1788509544.027003:0:15557:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcc865357e0 - data ffff8bcdac6b8ca8/ffff8bcc8645b800 00010000:00010000:0.0:1788509544.027839:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509544.027854:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509544.027868:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b400 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509544.027874:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509544.027889:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509544.027910:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509544.027918:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788509544.027922:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788509544.027925:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788509544.027950:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bcd836cb800 00010000:00010000:0.0:1788509544.027955:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509544.027962:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b400/0xe5156b86310dd8c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd8c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509544.027979:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509544.027984:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509544.028013:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b800 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509544.028110:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509544.028128:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509544.028134:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509544.028139:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788509544.028141:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788509544.028143:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788509544.028150:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bcd836cb800 00010000:00010000:0.0:1788509544.028153:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509544.028433:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b800/0xe5156b86310ddb2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310ddb31 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509544.028446:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509544.028448:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509544.028451:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509544.028853:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788509544.041890:0:15557:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788509544.085937:0:15557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd606 00000020:00000080:0.0:1788509544.085954:0:15557:0:(genops.c:885:class_export_put()) final put ffff8bcc86046000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788509544.085969:0:15557:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcd913e8000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788509544.085973:0:15557:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd913e8000 2 00000020:01000004:0.0:1788509544.085977:0:15557:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bcd913e8000 from lustre-OST0000 00000020:00000080:0.0:1788509544.086009:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509544.086033:0:15557:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788509544.086037:0:15557:0:(genops.c:885:class_export_put()) final put ffff8bcc86047000/lustre-OST0000_UUID 00000020:00000080:0.0:1788509544.086041:0:15557:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86047000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788509544.086048:0:15557:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1788509544.086140:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86046000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1788509544.090930:0:15557:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788509544.090951:0:15557:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788509544.090958:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788509544.090970:0:15557:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788509544.090980:0:15557:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8bcc86310000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788509544.090988:0:15557:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8bcc86303380) has exports, disconnecting them 00000020:00080000:2.0:1788509544.090995:0:15557:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8bcc86310000), last request at 1788509302 00000020:00000080:2.0:1788509544.091001:0:15557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd630 00000020:00080000:2.0:1788509544.091304:0:15557:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcc86310000): rc 0 00000020:00000080:2.0:1788509544.091312:0:15557:0:(genops.c:885:class_export_put()) final put ffff8bcc86310000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788509544.091362:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86310000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788509544.093976:0:15557:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788509544.093987:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788509544.093992:0:15557:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788509544.094001:0:15557:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788509544.094269:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788509544.094281:0:15557:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788509544.094291:0:15557:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788509544.094297:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788509544.094302:0:15557:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788509544.094324:0:15557:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8bcc86316000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788509544.094332:0:15557:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8bcc86300000) has exports, disconnecting them 00000020:00080000:3.0:1788509544.094337:0:15557:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8bcc86316000), last request at 1788509302 00000020:00000080:3.0:1788509544.094342:0:15557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd645 00000020:00080000:3.0:1788509544.094364:0:15557:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcc86316000): rc 0 00000020:00000080:3.0:1788509544.094370:0:15557:0:(genops.c:885:class_export_put()) final put ffff8bcc86316000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788509544.094775:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc86312000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788509544.094783:0:485:0:(genops.c:885:class_export_put()) final put ffff8bcc86041000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788509544.094787:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86041000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788509544.094795:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788509544.094883:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86316000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788509544.124397:0:15557:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788509544.124410:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788509544.124416:0:15557:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788509544.124426:0:15557:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788509544.124468:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc86311800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788509544.125926:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509544.125943:0:15557:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788509544.125951:0:15557:0:(genops.c:885:class_export_put()) final put ffff8bcc86315800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788509544.125956:0:15557:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc86315800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788509544.125970:0:15557:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788509544.126071:0:15557:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd913e8000 1 00000020:00000080:0.0:1788509544.126079:0:15557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd5ce 00000020:00000080:0.0:1788509544.126087:0:15557:0:(genops.c:885:class_export_put()) final put ffff8bcdbd313000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788509544.126108:0:15557:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788509544.126138:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd313000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788509544.126154:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788509544.126160:0:15557:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788509544.126164:0:15557:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8bcdbd058000) has no exports 00000100:00080000:1.0:1788509544.154820:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509544.154855:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509544.154858:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788509544.154862:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788509544.156693:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509544.156729:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796850816:0@lo:400:kworker.0 00000400:00000100:2.0:1788509544.156797:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796850816 offset 0 length 224: 4 00000020:00000080:2.0:1788509544.244014:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509544.244035:0:15557:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788509544.244043:0:15557:0:(genops.c:885:class_export_put()) final put ffff8bcd913eb800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788509544.244060:0:15557:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd913eb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788509544.244079:0:15557:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788509544.258688:0:15557:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8bcd913e9000 00000020:02000400:1.0:1788509544.258774:0:15557:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788509544.346201:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509545.368003:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509546.392531:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509547.417533:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788509547.877743:0:15759:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788509547.891471:0:15759:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788509547.891548:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509547.891563:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509547.891571:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509547.891579:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509547.891602:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788509547.891607:0:15759:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788509547.891630:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788509547.891642:0:15759:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcdb787e680 x1875387796849920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788509553 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788509547.891719:0:15355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509547.891726:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509547.891733:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a200 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509547.891738:0:15355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509547.891746:0:15355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509547.891753:0:15355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509547.891759:0:15355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788509547.891762:0:15355:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788509547.891764:0:15355:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788509547.891777:0:15355:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bcd836cb800 00010000:00010000:2.0:1788509547.891782:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509547.891789:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590a200/0xe5156b86310dd898 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd89f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509547.891800:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509547.891802:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509547.891817:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509547.891886:0:15759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788509547.891893:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788509547.891928:0:15759:0:(import.c:65:import_set_state_nolock()) ffff8bcc87392800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788509547.891934:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788509547.891945:0:15759:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcdb787e680 x1875387796849920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788509553 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509547.892401:0:15759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788509547.892482:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796849920:0@lo:38:kworker.0 00000100:00100000:3.0:1788509547.892529:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788509547.894537:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788509547.894551:0:15759:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcdb787f800 x1875387796850048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509549 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509547.894580:0:15759:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcc87357b80 x1875387796850304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509550 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509547.894590:0:15759:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcc87356a00 x1875387796850432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509554 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509547.894611:0:15759:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcc87354380 x1875387796850688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509554 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509547.894620:0:15759:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcc87355f80 x1875387796850816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509547.894628:0:15759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788509547.894634:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788509547.894658:0:15759:0:(import.c:65:import_set_state_nolock()) ffff8bcc87393800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788509547.894743:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796850816:0@lo:400:kworker.0 00000100:00100000:0.0:1788509547.894765:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796850304:0@lo:400:kworker.0 00000100:00100000:0.0:1788509547.894771:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796850048:0@lo:400:kworker.0 00000100:00100000:1.0:1788509547.894846:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796850688:0@lo:400:kworker.0 00000100:00100000:1.0:1788509547.894853:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875387796850432:0@lo:400:kworker.0 00000100:00100000:1.0:1788509547.894878:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875387796850944:0@lo:39:umount.0 00000400:00000100:1.0:1788509547.894951:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875387796850944 offset 0 length 224: 4 00010000:00010000:1.0:1788509548.438121:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788509549.270198:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788509549.270213:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788509549.464514:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509550.486811:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509551.514211:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509552.534437:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509553.046028:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509538/real 1788509538] req@ffff8bcc87355c00 x1875387796850560/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788509553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509553.046068:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87355c00 x1875387796850560/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788509553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788509553.046088:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd836cb800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788509553.046264:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788509553.046270:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3643:1875387796850560:0@lo:250:kworker.0 00000100:00080000:3.0:1788509553.046367:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788509553.046373:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788509553.046375:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcd836cb800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788509553.046861:0:485:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1788509553.046868:0:485:0:(import.c:630:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788509553.046875:0:485:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff8bcd836cb800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509553.047568:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd87c6a680 x1875387796851072/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788509553.047651:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3643:1875387796851072:0@lo:250:kworker.0 00000400:00000100:1.0:1788509553.047701:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875387796851072 offset 0 length 520: 4 00010000:00010000:2.0:1788509553.558389:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509554.587316:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509555.607466:0:15355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509556.630226:0:15356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509557.142608:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509547/real 1788509547] req@ffff8bcd87c68a80 x1875387796850944/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788509557 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509557.142716:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcd87c68a80 x1875387796850944/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788509557 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788509557.142738:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc87393800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788509557.142821:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875387796850944:0@lo:39:umount.0 00000100:00080000:3.0:1788509557.143527:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788509557.143533:0:15759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788509557.143539:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788509557.144633:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509557.144649:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509557.144656:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509557.144664:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509557.144694:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509557.144702:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509557.144710:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509557.144716:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509557.144723:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509557.144764:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788509557.144769:0:15759:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788509557.144791:0:15759:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788509557.144795:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788509557.144799:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788509557.144805:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788509557.144809:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8bcc870f3380) has no exports 00000020:00080000:3.0:1788509557.144831:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8bcc870f3380) has no exports 00010000:00010000:1.0:1788509557.145285:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509557.145293:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509557.145301:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925a00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509557.145304:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509557.145313:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509557.145321:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509557.145328:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788509557.145330:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788509557.145332:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788509557.145346:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bcd836cb800 00010000:00010000:1.0:1788509557.145349:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509557.145356:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcd92925a00/0xe5156b86310dd8a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd8ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509557.145377:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509557.145381:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509557.145387:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590b600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509557.145389:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509557.145396:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509557.145403:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509557.145408:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788509557.145410:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788509557.145412:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788509557.145417:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bcd836cb800 00010000:00010000:1.0:1788509557.145420:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509557.145427:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590b600/0xe5156b86310ddb1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310ddb23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509557.145439:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509557.145440:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509557.145442:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509557.145508:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788509557.147571:0:15759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcc8669a300 - data ffff8bcdac713af8/ffff8bcc876fd400 00000020:01000000:3.0:1788509557.147731:0:15759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bcc86535c60 - data ffff8bcdac6b91b0/ffff8bcdb5950400 00100000:10000000:3.0:1788509557.163082:0:15759:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788509557.174321:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd72c 00000020:00000080:0.0:1788509557.174333:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcdb784e000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788509557.174353:0:15759:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcdb59c5000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788509557.174356:0:15759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcdb59c5000 2 00000020:01000004:0.0:1788509557.174360:0:15759:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bcdb59c5000 from lustre-OST0001 00000020:00000080:0.0:1788509557.174379:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509557.174387:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788509557.174390:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcdb784f000/lustre-OST0001_UUID 00000020:00000080:0.0:1788509557.174393:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb784f000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788509557.174399:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1788509557.174436:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb784e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788509557.174548:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f3f21fff-d4b5-454c-a2da-1a3157f8f73e->MGS 00010000:00010000:0.0:1788509557.174565:0:15759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072e00/0xe5156b86310dd485 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd48c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509557.174577:0:15759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072e00/0xe5156b86310dd485 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd48c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509557.174583:0:15759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788509557.174586:0:15759:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788509557.174589:0:15759:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788509557.174605:0:15759:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bcd836cb800 00010000:00010000:0.0:1788509557.174608:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdc2072e00/0xe5156b86310dd485 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd48c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509557.174624:0:15759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe5156b86310dd90f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509557.174642:0:15759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe5156b86310dd90f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509557.174647:0:15759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788509557.174649:0:15759:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788509557.174651:0:15759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788509557.174658:0:15759:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bcd836cb800 00010000:00010000:0.0:1788509557.174661:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdb590be00/0xe5156b86310dd908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe5156b86310dd90f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788509557.174675:0:15759:0:(import.c:65:import_set_state_nolock()) ffff8bcd836cb800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788509557.174678:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788509557.174681:0:15759:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788509557.174682:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788509557.174687:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788509557.174696:0:15759:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bcd87c6a680 x1875387796851072/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788509573 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788509557.174717:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788509557.174720:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:1.0:1788509557.176732:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3f21fff-d4b5-454c-a2da-1a3157f8f73e:3643:1875387796851072:0@lo:250:kworker.0 10000000:01000000:0.0:1788509557.177705:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788509557.177722:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd382 00000020:00000080:0.0:1788509557.177731:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcd83140800/f3f21fff-d4b5-454c-a2da-1a3157f8f73e 00000020:01000000:0.0:1788509557.177754:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.112@tcp (flags='') 00000020:00000080:0.0:1788509557.177768:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788509557.177774:0:15759:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.112@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788509557.177778:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8bcd9e5d99c0) has no exports 10000000:01000000:2.0:1788509557.177831:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788509557.178200:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.112@tcp: client import never connected 00000100:00080000:0.0:1788509557.178204:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788509557.178207:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788509557.178211:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788509557.178227:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788509557.178260:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509557.178266:0:15759:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.112@tcp (uuid f3f21fff-d4b5-454c-a2da-1a3157f8f73e) 00000020:01000000:0.0:1788509557.178277:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788509557.178279:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788509557.178283:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788509557.178289:0:15759:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8bcc87393000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788509557.178294:0:15759:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8bcdbbec99c0) has exports, disconnecting them 00000020:00080000:0.0:1788509557.178299:0:15759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8bcc87393000), last request at 1788509323 00000020:00000080:0.0:1788509557.178302:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd756 00000020:00080000:0.0:1788509557.178323:0:15759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcc87393000): rc 0 00000020:00000080:0.0:1788509557.178327:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcc87393000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788509557.179126:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd83140800/f3f21fff-d4b5-454c-a2da-1a3157f8f73e for MGC192.168.203.112@tcp 00000020:00000080:1.0:1788509557.179137:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcd836cb800 for MGC192.168.203.112@tcp 00000020:00000080:1.0:1788509557.179144:0:485:0:(genops.c:885:class_export_put()) final put ffff8bcd89117000/f3f21fff-d4b5-454c-a2da-1a3157f8f73e 00000020:00000080:1.0:1788509557.179146:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcd89117000/f3f21fff-d4b5-454c-a2da-1a3157f8f73e for MGC192.168.203.112@tcp 00000020:01000000:1.0:1788509557.179150:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.112@tcp (f3f21fff-d4b5-454c-a2da-1a3157f8f73e) 00000020:00000080:1.0:1788509557.179389:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc87393000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788509557.179417:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788509557.179421:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788509557.179425:0:15759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788509557.179429:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788509557.179561:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788509557.179567:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788509557.179575:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788509557.179578:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788509557.179582:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788509557.179587:0:15759:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8bcc87397000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788509557.179591:0:15759:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8bcc874e19c0) has exports, disconnecting them 00000020:00080000:1.0:1788509557.179595:0:15759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8bcc87397000), last request at 1788509323 00000020:00000080:1.0:1788509557.179598:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd76b 00000020:00080000:1.0:1788509557.179609:0:15759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bcc87397000): rc 0 00000020:00000080:1.0:1788509557.179613:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcc87397000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788509557.180411:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc87392800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788509557.180421:0:485:0:(genops.c:885:class_export_put()) final put ffff8bcc810b5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788509557.180424:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc810b5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788509557.180435:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788509557.180497:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc87397000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788509557.183428:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788509557.183435:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788509557.183439:0:15759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788509557.183447:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788509557.183490:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bcc87393800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788509557.183535:0:15355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788509557.183694:0:15356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788509557.183746:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788509557.183803:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788509557.183917:0:7471:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8bcdbd1a6e00:7471] 2 exiting: rc = 0 00000100:00100000:2.0:1788509557.183976:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8bcd9248fe00:6504] 1 exiting: rc = 0 00000100:00100000:2.0:1788509557.184269:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8bcdaf81e200:6503] 0 exiting: rc = 1 00000100:00100000:2.0:1788509557.184332:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.184796:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8bcdb0e32400:6505] 0 exiting: rc = 1 00000100:00100000:2.0:1788509557.184876:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8bcdb0e32800:6506] 1 exiting: rc = 0 00000100:00100000:2.0:1788509557.185139:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8bcd83e4c400:6507] 2 exiting: rc = 0 00000100:00100000:2.0:1788509557.185225:0:7472:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8bcdbd1a2000:7472] 3 exiting: rc = 0 00000100:00100000:2.0:1788509557.185277:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185288:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185296:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185302:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185308:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185408:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185876:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185883:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185889:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.185895:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186253:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186259:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186265:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186271:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186278:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186284:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186290:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186296:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186302:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186309:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186325:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186331:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186336:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186342:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186347:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186353:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186359:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186364:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186369:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186374:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186379:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186385:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186390:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186394:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186410:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186416:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186421:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186427:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186433:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186438:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186443:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186449:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186455:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186461:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186473:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186482:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186487:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186496:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186502:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186510:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186515:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186521:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186525:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186530:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186534:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186539:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186544:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186548:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186554:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186559:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186564:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186575:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186580:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788509557.186584:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788509557.194579:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788509557.194591:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788509557.194597:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcc87394000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788509557.194601:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc87394000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788509557.194608:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788509557.194673:0:15759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcdb59c5000 1 00000020:00000080:2.0:1788509557.194679:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe5156b86310dd6fb 00000020:00000080:2.0:1788509557.194685:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcc810b1000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788509557.194698:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788509557.194711:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcc810b1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788509557.194722:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788509557.194727:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788509557.194731:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8bcdb46219c0) has no exports 00000020:00000080:0.0:1788509557.223299:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509557.223312:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788509557.223318:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcdb59c3800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788509557.223323:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdb59c3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788509557.223334:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788509557.223646:0:15759:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8bcdb59c4000 00000020:01000000:0.0:1788509557.223668:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788509557.223674:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788509557.223679:0:15759:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788509557.223682:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8bcdb4620000) has no exports 00000020:00000080:0.0:1788509557.223707:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788509557.223713:0:15759:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788509557.223717:0:15759:0:(genops.c:885:class_export_put()) final put ffff8bcdbd310000/OSS_uuid 00000020:00000080:0.0:1788509557.223719:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff8bcdbd310000/OSS_uuid for OSS 00000020:01000000:0.0:1788509557.223724:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788509557.223794:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8bcdb4446600:8436] 0 exiting: rc = 1 00000100:00100000:0.0:1788509557.223878:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8bcdb4735600:8437] 1 exiting: rc = 0 00000100:00100000:0.0:1788509557.223953:0:8756:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8bcc817d5800:8756] 3 exiting: rc = 0 00000100:00080000:2.0:1788509557.224226:0:6516:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788509557.224418:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8bcdbd2d6400:8438] 2 exiting: rc = 0 00000100:00100000:0.0:1788509557.224771:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224790:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224796:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224802:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224808:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224814:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224818:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224823:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224827:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224830:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224834:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224837:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224840:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224843:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224846:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224849:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224852:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224855:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224859:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224864:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224869:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224874:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224879:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224883:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224888:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.224892:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225241:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225249:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225254:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225258:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225263:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225268:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225273:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225277:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225282:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225287:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225298:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225303:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225308:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225312:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225317:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225321:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225326:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225331:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225335:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225340:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225345:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225350:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225355:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225359:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225462:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225468:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225473:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225478:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225484:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225489:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225494:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225498:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225503:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225509:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225514:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225519:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225525:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.225536:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.226833:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8bcdb4735c00:8440] 1 exiting: rc = 0 00000100:00100000:3.0:1788509557.227212:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8bcdbd2d7200:8439] 0 exiting: rc = 1 00000100:00100000:3.0:1788509557.227263:0:9005:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8bcc865e1800:9005] 2 exiting: rc = 0 00000100:00100000:0.0:1788509557.227461:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227475:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227482:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227487:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227494:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227500:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227515:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227520:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227525:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227531:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227535:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227540:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227545:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227550:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227555:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227559:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227565:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227570:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227575:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227580:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227585:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227589:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227594:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227602:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227608:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227613:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227618:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227624:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227630:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227634:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227639:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227644:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227649:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227655:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227661:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227667:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227672:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227743:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227750:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227755:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227761:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227774:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227778:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227783:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227792:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227798:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227803:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227809:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227814:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227820:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227825:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227831:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227837:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227842:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227847:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227852:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227860:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227867:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227872:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227878:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227883:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227889:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227894:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.227922:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229035:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8bcdb4734e00:8441] 0 exiting: rc = 1 00000100:00100000:2.0:1788509557.229320:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8bcdb4735800:8443] 2 exiting: rc = 0 00000100:00100000:3.0:1788509557.229323:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8bcdb4734000:8442] 1 exiting: rc = 0 00000100:00100000:1.0:1788509557.229593:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229601:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229606:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229612:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229618:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229635:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229640:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229645:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229651:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229656:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229661:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229667:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229672:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229747:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229755:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229761:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229767:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229772:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229778:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229801:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229807:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229814:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229819:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229826:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229831:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229836:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229841:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229846:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229852:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229857:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229862:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229868:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229873:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229878:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229884:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.229890:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230305:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230314:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230320:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230325:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230337:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230341:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230347:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230669:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230689:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230694:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230700:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230706:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230711:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230716:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230722:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230728:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230733:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230738:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230743:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230749:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230763:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230770:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230784:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230791:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230796:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230802:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230808:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.230820:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788509557.237358:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8bcdbd30d200:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1788509557.246146:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8bcdbd30c200:8445] 1 exiting: rc = 0 00000100:00100000:1.0:1788509557.246309:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246324:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246331:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246337:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246342:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246348:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246354:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246359:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246439:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246447:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246452:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246468:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246474:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246478:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246483:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246488:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246493:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246499:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246505:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246511:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246516:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246522:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246527:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246533:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246538:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246544:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246549:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246553:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246559:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246564:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246569:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246575:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246580:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246586:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246592:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246597:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246601:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246606:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246612:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246617:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246622:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246628:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246633:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246638:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246643:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246648:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246661:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246667:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246672:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246750:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246758:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246763:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246769:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246774:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246779:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246784:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246789:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246794:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246799:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246803:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246808:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246813:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246817:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788509557.246822:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.247854:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8bcdbd1a7200:8447] 1 exiting: rc = 0 00000100:00100000:2.0:1788509557.248747:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8bcdbd1a7000:8446] 0 exiting: rc = 1 00000100:00100000:0.0:1788509557.248801:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248816:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248822:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248829:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248834:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248840:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248845:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248851:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248856:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248862:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248878:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248918:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248926:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248932:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248938:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248943:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248949:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248954:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248960:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248966:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248972:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248978:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.248984:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249007:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249013:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249020:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249037:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249044:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249050:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249056:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249062:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249069:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249075:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249081:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249087:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249109:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249116:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249121:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249127:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249133:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249138:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249144:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249149:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249155:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249161:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249185:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249192:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249212:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249218:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249224:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249230:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249237:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249242:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249247:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249253:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249259:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249265:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249276:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249282:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249303:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249309:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249315:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249322:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788509557.249334:0:15759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788509557.256325:0:15759:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788509573.920003:0:16524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788509583.038448:0:17123:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788509583.038457:0:17123:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788509583.038459:0:17123:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788509583.038583:0:17123:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bcc870ca000 00000020:01000004:0.0:1788509583.038603:0:17123:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788509583.038611:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788509583.038629:0:17123:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8bcc874e4d40) 00000020:00000080:0.0:1788509583.038646:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788509583.159785:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788509583.161567:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788509583.169512:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788509583.170709:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788509583.171694:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788509583.172044:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788509583.172956:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788509583.174406:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.176662:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.178346:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.180811:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.181701:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.182699:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.183126:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.184960:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.185478:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.185859:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.188002:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.189808:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.190609:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.191026:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.191278:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.191561:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.191788:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.192173:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.192744:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.193104:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.193449:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.193687:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.194007:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.194411:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.194662:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.194994:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788509583.195247:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788509583.198523:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.199543:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.199829:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.200093:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.200365:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788509583.201089:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788509583.201982:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788509583.203465:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788509583.204026:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.205515:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788509583.208723:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788509583.210579:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.211352:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.214754:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.216096:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.216379:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.216957:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.217220:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788509583.217482:0:17123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1788509583.218178:0:17123:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788509583.218462:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788509583.218474:0:17123:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788509583.218490:0:17123:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310de93f 00000020:01000004:3.0:1788509583.218498:0:17123:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788509583.218503:0:17123:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788509583.218510:0:17123:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bcc870ca000 from MGS 00000020:01000004:3.0:1788509583.218514:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788509583.218527:0:17123:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8bcc870f19c0) 00000020:00000080:3.0:1788509583.218538:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788509583.218622:0:17123:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcc870ca000 from MGS, refs=2 00080000:01000000:3.0:1788509583.218628:0:17123:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788509583.218633:0:17123:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310de94d 00000100:00100000:3.0:1788509583.218753:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788509583.218934:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788509583.218942:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788509583.219477:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788509583.219484:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788509583.220387:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509583.220591:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788509583.220598:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788509583.232293:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788509583.232314:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788509583.233072:0:17123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788509583.233080:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788509583.236510:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509583.236517:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509583.236520:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509583.237147:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509583.237151:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509583.237153:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509583.238114:0:17123:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788509583.243260:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788509583.244712:0:17123:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788509583.256093:0:17136:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788509583.256172:0:17123:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788509583.256270:0:17123:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788509583.257163:0:17123:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788509583.257567:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788509583.257753:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788509583.257761:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788509583.263727:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788509583.263746:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788509583.264309:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788509583.264318:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788509583.265072:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788509583.265099:0:17123:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:2.0:1788509583.265101:0:17123:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788509583.265144:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:2.0:1788509583.265161:0:17123:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (ffff8bcdb4623380) 00000020:00000080:2.0:1788509583.265182:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788509583.265292:0:17123:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcd87b29000@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788509583.265485:0:17123:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:2.0:1788509583.265492:0:17123:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788509583.267971:0:17140:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788509583.271751:0:17142:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788509583.271881:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid 830aae98-6419-4d90-97fb-7d4af2af47a0) 00000020:00000080:3.0:1788509583.271998:0:17123:0:(genops.c:1385:class_connect()) connect: client 830aae98-6419-4d90-97fb-7d4af2af47a0, cookie 0xe5156b86310de95b 00000100:00080000:3.0:1788509583.272023:0:17123:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788509583.272032:0:17123:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff8bcd87b29000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509583.272076:0:17123:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd87c69f80 x1875387796851200/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788509583.272102:0:17123:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 830aae98-6419-4d90-97fb-7d4af2af47a0->MGS 00000020:01000004:3.0:1788509583.272130:0:17123:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788509583.272158:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788509583.272176:0:17123:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8bcc870f4d40) 00000020:00000080:3.0:1788509583.272199:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788509583.272451:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:830aae98-6419-4d90-97fb-7d4af2af47a0:3643:1875387796851200:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788509583.272540:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509583.272706:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796851200 00000100:00100000:1.0:1788509583.272728:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796851200 00000100:00100000:1.0:1788509583.272819:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788509583.272828:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875387796851200:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788509583.272886:0:17137:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 830aae98-6419-4d90-97fb-7d4af2af47a0@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:1.0:1788509583.272940:0:17137:0:(genops.c:1385:class_connect()) connect: client 830aae98-6419-4d90-97fb-7d4af2af47a0, cookie 0xe5156b86310de969 00000100:00080000:1.0:1788509583.276311:0:17137:0:(import.c:65:import_set_state_nolock()) ffff8bcd83760000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509583.276473:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+5:3643:x1875387796851200:12345-0@lo:250:mount.lustre.0 Request processed in 3637us (3926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509583.276488:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788509583.276607:0:3643:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788509583.276620:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:1.0:1788509583.276630:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788509583.276636:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788509583.276640:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd87b29000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788509583.276643:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788509583.276660:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788509583.276666:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:830aae98-6419-4d90-97fb-7d4af2af47a0:3643:1875387796851200:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788509583.299678:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509583.299975:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788509583.299983:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788509583.302621:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788509583.302637:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788509583.303286:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788509583.303296:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788509583.304383:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509583.304607:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788509583.304613:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788509583.305340:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788509583.305347:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788509583.375642:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509583.375869:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788509583.375875:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788509583.377421:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788509583.377431:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788509583.379719:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509583.380003:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788509583.382093:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788509583.387036:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788509583.387053:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788509583.392610:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509583.392807:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788509583.392813:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788509583.393718:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788509583.393726:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788509583.394391:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509583.394532:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788509583.394536:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788509583.396756:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788509583.396768:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788509583.421484:0:17123:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509583.421687:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788509583.421694:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788509583.425020:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788509583.425036:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788509583.428062:0:17123:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788509583.428078:0:17123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788509583.430359:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788509583.430390:0:17123:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788509583.430402:0:17123:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788509583.430504:0:17123:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788509583.430533:0:17123:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788509583.430537:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788509583.430539:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788509583.430540:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509583.430541:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509583.430542:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509583.430543:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509583.430544:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788509583.430545:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788509583.430547:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509583.430548:0:17123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788509583.430550:0:17123:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788509583.430552:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788509583.430553:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788509583.430554:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509583.430556:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509583.430556:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509583.430557:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509583.430558:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788509583.430559:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788509583.430560:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509583.430561:0:17123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788509583.430584:0:17123:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788509583.430601:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851328:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788509583.430668:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509583.430736:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb1090900 going to sleep for 11 seconds 00000100:00100000:0.0:1788509583.430944:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796851328 00000100:00100000:0.0:1788509583.430953:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796851328 00000100:00100000:0.0:1788509583.430992:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509583.431000:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+5:17123:x1875387796851328:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788509583.431042:0:17139:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788509583.431055:0:17139:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788509583.431058:0:17139:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788509583.433995:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788509583.435834:0:17139:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788509583.438945:0:17161:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788509583.438954:0:17161:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788509583.438958:0:17161:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788509583.438961:0:17161:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788509583.439157:0:17161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788509583.440024:0:17139:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788509583.440035:0:17139:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788509583.442067:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+5:17123:x1875387796851328:12345-0@lo:253:mount.lustre.0 Request processed in 11059us (11390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509583.442088:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509583.442491:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788509583.442506:0:17123:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788509583.442508:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788509583.442510:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788509583.442511:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509583.442512:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509583.442514:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509583.442515:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509583.442516:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788509583.442518:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788509583.442530:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509583.442531:0:17123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788509583.442550:0:17123:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bcc870ca000 from lustre-MDT0000 10000000:01000000:2.0:1788509583.442582:0:17123:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788509583.442585:0:17123:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788509583.442590:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8bcdb4623380 10000000:01000000:2.0:1788509583.442595:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788509583.442602:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bcdb4623380 from 1 10000000:01000000:2.0:1788509583.442605:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788509583.442642:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.442653:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.442663:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509583.442682:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788509583.442722:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509583.442791:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5980a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788509583.442840:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796851456 00000100:00100000:1.0:1788509583.442847:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796851456 00000100:00100000:1.0:1788509583.442956:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509583.442966:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+5:17123:x1875387796851456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509583.442977:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509583.442992:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862afc00/0xe5156b86310de977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310de970 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.443013:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862afc00/0xe5156b86310de977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310de970 expref: 6 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.443022:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862afc00/0xe5156b86310de977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310de970 expref: 6 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.443031:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862afc00, rc 0) 00000100:00100000:1.0:1788509583.443075:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+6:17123:x1875387796851456:12345-0@lo:101:mount.lustre.0 Request processed in 110us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509583.443090:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509583.443159:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509583.443178:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.443199:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509583.443263:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509583.443306:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509583.443699:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509583.443774:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796851584 00000100:00100000:2.0:1788509583.443779:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796851584 00000100:00100000:2.0:1788509583.443808:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788509583.443815:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+6:17123:x1875387796851584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509583.443939:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+6:17123:x1875387796851584:12345-0@lo:501:mount.lustre.0 Request processed in 124us (631us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509583.443947:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788509583.444027:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851584:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788509583.444060:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788509583.444082:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444091:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509583.444099:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bcc870ca000 10000000:01000000:3.0:1788509583.444103:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788509583.444107:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8bcc870ca000 10000000:01000000:3.0:1788509583.444109:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788509583.444112:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8bcc870ca000 from 1 10000000:01000000:3.0:1788509583.444115:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788509583.444136:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8c00/0xe5156b86310de97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444143:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8c00/0xe5156b86310de97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444163:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8c00/0xe5156b86310de97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509583.444177:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788509583.444224:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509583.444242:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509583.444502:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796851712 00000100:00100000:2.0:1788509583.444506:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796851712 00000100:00100000:2.0:1788509583.444534:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788509583.444540:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+6:17123:x1875387796851712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509583.444547:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509583.444559:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce2200/0xe5156b86310de985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310de97e expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.444574:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce2200/0xe5156b86310de985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310de97e expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.444583:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce2200/0xe5156b86310de985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310de97e expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.444591:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2200, rc 0) 00000100:00100000:2.0:1788509583.444629:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+7:17123:x1875387796851712:12345-0@lo:101:mount.lustre.0 Request processed in 89us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509583.444636:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509583.444708:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509583.444718:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8c00/0xe5156b86310de97e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de985 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444726:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8c00/0xe5156b86310de97e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310de985 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509583.444736:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788509583.444749:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8c00/0xe5156b86310de97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de985 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444755:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8c00/0xe5156b86310de97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de985 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509583.444759:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788509583.444763:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788509583.444766:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8bcc870ca000 10000000:01000000:3.0:1788509583.444769:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788509583.444771:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788509583.444773:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788509583.444786:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9e00/0xe5156b86310de98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444797:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9e00/0xe5156b86310de98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444805:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9e00/0xe5156b86310de98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509583.444816:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788509583.444839:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509583.444872:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796851840 00000100:00100000:3.0:1788509583.444875:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796851840 00000100:00100000:3.0:1788509583.444892:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788509583.444918:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+7:17123:x1875387796851840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509583.444925:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509583.444934:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310de993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310de98c expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444947:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310de993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310de98c expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444954:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8000/0xe5156b86310de993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310de98c expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.444960:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8000, rc 0) 00000100:00100000:3.0:1788509583.444982:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+8:17123:x1875387796851840:12345-0@lo:101:mount.lustre.0 Request processed in 84us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509583.444988:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788509583.445012:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509583.445043:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509583.445054:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9e00/0xe5156b86310de98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de993 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.445061:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9e00/0xe5156b86310de98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310de993 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509583.445171:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509583.445412:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509583.445476:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509583.445608:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796851968 00000100:00100000:1.0:1788509583.445614:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796851968 00000100:00100000:2.0:1788509583.445660:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509583.445672:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+8:17123:x1875387796851968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509583.445792:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+9:17123:x1875387796851968:12345-0@lo:501:mount.lustre.0 Request processed in 124us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509583.445798:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788509583.445873:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796851968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509583.445914:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796852096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788509583.445950:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509583.445969:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83e8be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509583.446017:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796852096 00000100:00100000:2.0:1788509583.446021:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796852096 00000100:00100000:2.0:1788509583.446039:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788509583.446044:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+9:17123:x1875387796852096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788509583.446847:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+9:17123:x1875387796852096:12345-0@lo:503:mount.lustre.0 Request processed in 798us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509583.446878:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788509583.447314:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796852096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509583.447703:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17162:1875387796852224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509583.447757:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.447829:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd81254c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509583.447879:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796852224 00000100:00100000:3.0:1788509583.447885:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796852224 00000100:00100000:3.0:1788509583.448056:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788509583.448064:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+9:17162:x1875387796852224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509583.448759:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+9:17162:x1875387796852224:12345-0@lo:502:llog_process_th.0 Request processed in 693us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509583.448767:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509583.448859:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17162:1875387796852224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509583.448887:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509583.448932:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509583.448935:0:17162:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788509583.448940:0:17162:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788509583.448943:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788509583.448958:0:17162:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8bcc874e3380) 00000020:00000080:0.0:1788509583.448973:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788509583.448984:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788509583.449258:0:17162:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788509583.449266:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310de9a1 00000020:00000080:0.0:1788509583.449463:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788509583.449468:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509583.449472:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509583.449473:0:17162:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788509583.449475:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509583.449479:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509583.449480:0:17162:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788509583.449483:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788509583.449491:0:17162:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8bcc874e0000) 00000020:00000080:0.0:1788509583.449501:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788509583.449506:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788509583.449507:0:17162:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788509583.449510:0:17162:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788509583.449516:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788509583.449561:0:17162:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcc870ca000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788509583.449573:0:17162:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8bcc874e19c0) 00000020:00000080:0.0:1788509583.449581:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788509583.449643:0:17162:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788509583.449650:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310de9b6 00000020:00000080:0.0:1788509583.449736:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788509583.449743:0:17162:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788509583.449747:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe5156b86310de9bd 00080000:01000000:0.0:1788509583.449752:0:17162:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788509583.449756:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310de9c4 00010000:00010000:2.0:1788509583.513685:0:17162:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788509583.514280:0:17162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788509583.514673:0:17162:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788509583.515207:0:17162:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8bcdb4624d40) 00000020:00000080:2.0:1788509583.515231:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788509583.515298:0:17162:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788509583.515304:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310de9d2 00000020:00000080:3.0:1788509583.516009:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788509583.522583:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe5156b86310de9d9 00000020:00000080:1.0:1788509583.526911:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788509583.526927:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509583.526935:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509583.526937:0:17162:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788509583.526941:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788509583.526943:0:17162:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788509583.526945:0:17162:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788509583.526947:0:17162:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788509583.526948:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788509583.526951:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509583.526952:0:17162:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788509583.526954:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509583.526958:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509583.526959:0:17162:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788509583.526964:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788509583.527011:0:17162:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788509583.527024:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509583.527027:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509583.527028:0:17162:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788509583.527030:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509583.527033:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509583.527034:0:17162:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788509583.527036:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788509583.527041:0:17162:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:1.0:1788509583.527067:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509583.527083:0:17162:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8bcc86304d40) 00000020:00000080:1.0:1788509583.527100:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788509583.527104:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788509583.527155:0:17162:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788509583.527169:0:17162:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788509583.527176:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310de9e7 00010000:00080000:1.0:1788509583.527394:0:17162:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcdbbf08000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509583.531037:0:17162:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788509583.534404:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788509583.534420:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788509583.534704:0:17162:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788509583.534727:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310de9ee 00000100:00080000:1.0:1788509583.534738:0:17162:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788509583.534744:0:17162:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8bcdbbf08000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509583.534782:0:17162:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87355c00 x1875387796852352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509583.534891:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796852352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788509583.534995:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509583.535201:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796852352 00000100:00100000:3.0:1788509583.535208:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796852352 00000100:00100000:3.0:1788509583.535320:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509583.535329:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875387796852352:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788509583.535344:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788509583.535986:0:17162:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788509583.536078:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509583.536084:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509583.536086:0:17162:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788509583.536089:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788509583.536092:0:17162:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788509583.536094:0:17162:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788509583.536095:0:17162:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788509583.536096:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788509583.536099:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509583.536100:0:17162:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788509583.536102:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788509583.536107:0:17162:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788509583.536110:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509583.536111:0:17162:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788509583.536114:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788509583.536118:0:17162:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1788509583.536138:0:17162:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788509583.536141:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509583.536160:0:17162:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8bcc86300000) 00000020:00000080:1.0:1788509583.536174:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788509583.536179:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788509583.537364:0:17162:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788509583.537371:0:17162:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788509583.537380:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310de9fc 00010000:00080000:1.0:1788509583.537413:0:17162:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcd9f604000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509583.537759:0:17162:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788509583.544402:0:17162:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788509583.545316:0:17162:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788509583.553548:0:17162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509583.553878:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788509583.563268:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788509583.565061:0:17168:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788509583.565070:0:17168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788509583.566165:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788509583.566178:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788509583.566225:0:17162:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788509583.566246:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dea03 00000100:00080000:2.0:1788509583.566256:0:17162:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788509583.566262:0:17162:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bcd9f604000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509583.566428:0:17162:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb787c000 x1875387796852480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788509583.566626:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796852480:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788509583.566679:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796852480 offset 0 length 520: 4 00000100:00080000:2.0:1788509583.566731:0:17162:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788509583.566793:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509583.566797:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.566800:0:17162:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788509583.566804:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788509583.566806:0:17162:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788509583.566808:0:17162:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788509583.566809:0:17162:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788509583.566811:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788509583.566813:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.566814:0:17162:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788509583.566827:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788509583.566831:0:17162:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788509583.566835:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.566836:0:17162:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788509583.566838:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788509583.566842:0:17162:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1788509583.566872:0:17162:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788509583.566875:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788509583.566888:0:17162:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8bcdb4620000) 00000020:00000080:2.0:1788509583.566922:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788509583.566929:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788509583.566988:0:17162:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788509583.566994:0:17162:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788509583.567000:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe5156b86310dea11 00010000:00080000:2.0:1788509583.567040:0:17162:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc810b5000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788509583.567259:0:17162:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788509583.567337:0:17162:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788509583.567353:0:17162:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788509583.574614:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875387796852352:12345-0@lo:38:llog_process_th.0 Request processed in 39273us (39607us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788509583.574665:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788509583.574732:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788509583.574737:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788509583.574742:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796852352:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788509583.579155:0:17162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509583.580845:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788509583.581303:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788509583.582472:0:17170:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788509583.582482:0:17170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788509583.584587:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788509583.584607:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788509583.584666:0:17162:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788509583.584691:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310dea18 00000100:00080000:0.0:1788509583.584726:0:17162:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788509583.584734:0:17162:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bcc810b5000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509583.584798:0:17162:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87783480 x1875387796852608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788509583.584833:0:17162:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788509583.584953:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509583.584959:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509583.584961:0:17162:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788509583.584965:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509583.584970:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509583.584972:0:17162:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788509583.584976:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788509583.584979:0:17162:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788509583.584981:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509583.584984:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509583.584985:0:17162:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788509583.584988:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509583.584990:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509583.585000:0:17162:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788509583.585005:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788509583.585291:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796852608:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788509583.585376:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796852608 offset 0 length 520: 4 00000100:00100000:0.0:1788509583.586180:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17162:1875387796852736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509583.586259:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.587131:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509583.587347:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796852736 00000100:00100000:2.0:1788509583.587357:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796852736 00000100:00100000:2.0:1788509583.587431:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788509583.587456:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+9:17162:x1875387796852736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788509583.587716:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+9:17162:x1875387796852736:12345-0@lo:502:llog_process_th.0 Request processed in 262us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509583.587725:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509583.587980:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17162:1875387796852736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788509583.588163:0:17162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509583.588171:0:17162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509583.588173:0:17162:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788509583.588178:0:17162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788509583.591475:0:17123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788509583.591531:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788509583.591561:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9e00/0xe5156b86310de98c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de993 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.591578:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9e00/0xe5156b86310de98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de993 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509583.591693:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcc870ca000 from 1 10000000:01000000:2.0:1788509583.591699:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788509583.591767:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.591777:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.591791:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509583.591827:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796852864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788509583.592132:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509583.592230:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788509583.594667:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796852864 00000100:00100000:2.0:1788509583.594689:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796852864 00000100:00100000:2.0:1788509583.594810:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509583.594822:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+9:17123:x1875387796852864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509583.594845:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509583.594880:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dea1f expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.594942:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dea1f expref: 10 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.594981:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea1f expref: 10 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.594992:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3400, rc 0) 00000100:00100000:2.0:1788509583.595129:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+10:17123:x1875387796852864:12345-0@lo:101:mount.lustre.0 Request processed in 309us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509583.595138:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788509583.595250:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796852864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509583.595274:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.595285:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509583.599565:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796852992:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788509583.599692:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.599770:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509583.600157:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796852992 00000100:00100000:2.0:1788509583.600168:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796852992 00000100:00100000:2.0:1788509583.600283:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788509583.600302:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+10:17123:x1875387796852992:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788509583.600330:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788509583.600337:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788509583.600447:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+10:17123:x1875387796852992:12345-0@lo:256:mount.lustre.0 Request processed in 154us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509583.600455:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788509583.600538:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796852992:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788509583.601240:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788509583.601273:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.601287:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509583.601296:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcc870ca000 from 1 10000000:01000000:0.0:1788509583.601299:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509583.601350:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.601359:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.601371:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509583.601390:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788509583.601437:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.601938:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788509583.602103:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796853120 00000100:00100000:1.0:1788509583.602113:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796853120 00000100:00100000:1.0:1788509583.602162:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788509583.602171:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+10:17123:x1875387796853120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509583.602186:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509583.602204:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dea2d expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.602233:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dea2d expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.602246:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea2d expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.602273:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af800, rc 0) 00000100:00100000:1.0:1788509583.602566:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17123:x1875387796853120:12345-0@lo:101:mount.lustre.0 Request processed in 394us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509583.602573:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788509583.602654:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788509583.602673:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.602684:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509583.602779:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509583.602813:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.602885:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509583.603148:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796853248 00000100:00100000:2.0:1788509583.603155:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796853248 00000100:00100000:2.0:1788509583.603238:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788509583.603249:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17123:x1875387796853248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509583.603595:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17123:x1875387796853248:12345-0@lo:501:mount.lustre.0 Request processed in 347us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509583.603603:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788509583.603749:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509583.603790:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509583.603843:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.603972:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda629cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509583.604150:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796853376 00000100:00100000:2.0:1788509583.604158:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796853376 00000100:00100000:2.0:1788509583.604188:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788509583.604206:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17123:x1875387796853376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788509583.604448:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17123:x1875387796853376:12345-0@lo:503:mount.lustre.0 Request processed in 243us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509583.604455:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788509583.604609:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788509583.605285:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17172:1875387796853504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788509583.605496:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509583.605582:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788509583.605636:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796853504 00000100:00100000:0.0:1788509583.605642:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796853504 00000100:00100000:0.0:1788509583.605731:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788509583.605742:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17172:x1875387796853504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509583.606337:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17172:x1875387796853504:12345-0@lo:502:llog_process_th.0 Request processed in 588us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509583.606351:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509583.606435:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17172:1875387796853504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788509583.606475:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509583.606488:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.606491:0:17172:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788509583.606499:0:17172:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcc870ca000 00000020:00000080:2.0:1788509583.606501:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788509583.606511:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509583.606513:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.606515:0:17172:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788509583.606518:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509583.606520:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.606522:0:17172:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788509583.606525:0:17172:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcc870ca000 00000020:00000080:2.0:1788509583.606527:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788509583.606602:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509583.606606:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.606607:0:17172:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788509583.606610:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509583.606614:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.606616:0:17172:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788509583.606620:0:17172:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcc870ca000 00000020:00000080:2.0:1788509583.606622:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788509583.606649:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509583.606652:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.606653:0:17172:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788509583.606655:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509583.606658:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509583.606659:0:17172:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788509583.606662:0:17172:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcc870ca000 00000020:00000080:2.0:1788509583.606664:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788509583.606701:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17172:1875387796853632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788509583.606751:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509583.606929:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796853632 00000100:00100000:3.0:1788509583.606940:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796853632 00000100:00100000:2.0:1788509583.606960:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788509583.608060:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788509583.608073:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17172:x1875387796853632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509583.608261:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17172:x1875387796853632:12345-0@lo:502:llog_process_th.0 Request processed in 191us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509583.608269:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788509583.609744:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17172:1875387796853632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788509583.609790:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509583.609798:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509583.609800:0:17172:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788509583.609805:0:17172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788509583.609963:0:17123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788509583.610024:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788509583.610048:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.610060:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509583.610113:0:17123:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788509583.610116:0:17123:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bcc870ca000 10000000:01000000:2.0:1788509583.610119:0:17123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bcc870ca000 10000000:01000000:2.0:1788509583.610123:0:17123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788509583.610129:0:17123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcc870ca000 from 1 10000000:01000000:2.0:1788509583.610131:0:17123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788509583.610162:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2e00/0xe5156b86310dea3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.610170:0:17123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2e00/0xe5156b86310dea3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.610201:0:17123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2e00/0xe5156b86310dea3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509583.610287:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788509583.610345:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509583.610419:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788509583.610534:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796853760 00000100:00100000:1.0:1788509583.610541:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796853760 00000100:00100000:1.0:1788509583.610588:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788509583.610597:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17123:x1875387796853760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509583.610608:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509583.610620:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862ae600/0xe5156b86310dea42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dea3b expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.610644:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862ae600/0xe5156b86310dea42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dea3b expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.610653:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862ae600/0xe5156b86310dea42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea3b expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.610661:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae600, rc 0) 00000100:00100000:1.0:1788509583.610698:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17123:x1875387796853760:12345-0@lo:101:mount.lustre.0 Request processed in 103us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509583.610715:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509583.610868:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509583.610882:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2e00/0xe5156b86310dea3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea42 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.610892:0:17123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2e00/0xe5156b86310dea3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dea42 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509583.610971:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509583.610999:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509583.611023:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788509583.611315:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796853888 00000100:00100000:3.0:1788509583.611327:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796853888 00000100:00100000:3.0:1788509583.611362:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788509583.611371:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17123:x1875387796853888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509583.611490:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17123:x1875387796853888:12345-0@lo:501:mount.lustre.0 Request processed in 120us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509583.611497:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509583.611972:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796853888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509583.612003:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796854016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788509583.612043:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509583.612109:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788509583.621482:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796854016 00000100:00100000:1.0:1788509583.621497:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796854016 00000100:00100000:1.0:1788509583.621570:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788509583.621581:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17123:x1875387796854016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788509583.621761:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17123:x1875387796854016:12345-0@lo:503:mount.lustre.0 Request processed in 180us (9716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509583.621771:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788509583.622428:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796854016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509583.629032:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17176:1875387796854144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509583.630814:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509583.631035:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509583.631247:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796854144 00000100:00100000:3.0:1788509583.631256:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796854144 00000100:00100000:3.0:1788509583.631344:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788509583.631355:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17176:x1875387796854144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509583.631518:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17176:x1875387796854144:12345-0@lo:502:llog_process_th.0 Request processed in 165us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509583.631527:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788509583.631607:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17176:1875387796854144:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788509583.631670:0:17176:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788509583.631686:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8bcd9e5d99c0) 00000020:00000080:0.0:1788509583.631704:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788509583.631789:0:17176:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcc870ca000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788509583.631793:0:17176:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcc870ca000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788509583.631795:0:17176:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcc870ca000 4 00010000:00080000:0.0:1788509583.631832:0:17176:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcd913eb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788509583.636308:0:17176:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788509583.636571:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788509583.636622:0:17176:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788509583.636638:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe5156b86310dea50 00000100:00080000:0.0:1788509583.636649:0:17176:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788509583.636655:0:17176:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8bcd913eb800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509583.636698:0:17176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87783800 x1875387796854272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788509583.636728:0:17176:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788509583.636923:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796854272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788509583.636997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.637063:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17176:1875387796854400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788509583.637080:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796854272 00000100:00100000:3.0:1788509583.637087:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796854272 00000100:00100000:0.0:1788509583.637112:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.637129:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842780 going to sleep for 11 seconds 00000100:00100000:3.0:1788509583.637178:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509583.637194:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875387796854272:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788509583.637311:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875387796854272:12345-0@lo:38:llog_process_th.0 Request processed in 116us (314us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788509583.637319:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509583.637354:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788509583.637361:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd913eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509583.637366:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788509583.637370:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796854272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788509583.637714:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796854400 00000100:00100000:1.0:1788509583.637720:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796854400 00000100:00100000:1.0:1788509583.637751:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788509583.637758:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17176:x1875387796854400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788509583.637886:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17176:x1875387796854400:12345-0@lo:502:llog_process_th.0 Request processed in 128us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509583.637894:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788509583.638062:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17176:1875387796854400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509583.638103:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17176:1875387796854528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509583.638140:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.638162:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796854528 00000100:00100000:0.0:1788509583.638165:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796854528 00000100:00100000:0.0:1788509583.638232:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788509583.638240:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17176:x1875387796854528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788509583.638301:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17176:x1875387796854528:12345-0@lo:502:llog_process_th.0 Request processed in 61us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509583.638308:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788509583.638384:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842780 going to sleep for 11 seconds 00000100:00100000:0.0:1788509583.638401:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:830aae98-6419-4d90-97fb-7d4af2af47a0:17176:1875387796854528:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788509583.638427:0:17176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788509583.638588:0:17123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788509583.638610:0:17123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788509583.638626:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2e00/0xe5156b86310dea3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea42 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509583.638636:0:17123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2e00/0xe5156b86310dea3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea42 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788509583.638679:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788509583.638681:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788509583.638686:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509583.638687:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509583.638689:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509583.638690:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509583.638691:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509583.638693:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788509583.638694:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509583.638695:0:17123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788509583.638699:0:17123:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788509583.638702:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788509583.638703:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788509583.638704:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509583.638705:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509583.638706:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509583.638707:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509583.638709:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509583.638710:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788509583.638710:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509583.638712:0:17123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788509583.638727:0:17123:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788509583.638738:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796854656:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788509583.638775:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509583.640489:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788509583.640568:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796854656 00000100:00100000:0.0:1788509583.640577:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796854656 00000100:00100000:0.0:1788509583.640666:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788509583.640677:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17123:x1875387796854656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788509583.640704:0:17137:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788509583.640718:0:17137:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788509583.642438:0:17137:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788509583.642450:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788509583.642510:0:17160:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788509583.642515:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788509583.642538:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.642555:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea1f expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.642563:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.642598:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dea1f expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.642612:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dea1f expref: 12 pid: 17139 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509583.642625:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796854784:0@lo:104: 00000100:00100000:0.0:1788509583.642692:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509583.642727:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842780 going to sleep for 11 seconds 00000100:00100000:0.0:1788509583.644042:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17123:x1875387796854656:12345-0@lo:253:mount.lustre.0 Request processed in 3361us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509583.644062:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788509583.644085:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796854784 00000100:00100000:3.0:1788509583.644095:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796854784 00000100:00100000:1.0:1788509583.644299:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17123:1875387796854656:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788509583.644313:0:17123:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788509583.644317:0:17123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788509583.644319:0:17123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788509583.644320:0:17123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788509583.644322:0:17123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788509583.644323:0:17123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788509583.644325:0:17123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788509583.644326:0:17123:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788509583.644328:0:17123:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788509583.644330:0:17123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788509583.644331:0:17123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788509583.644346:0:17123:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788509583.645316:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509583.645330:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:17160:x1875387796854784:12345-0@lo:104: 00010000:00010000:3.0:1788509583.645349:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.645436:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509583.645442:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:17160:x1875387796854784:12345-0@lo:104: Request processed in 117us (2750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509583.645448:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509583.645523:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796854784:0@lo:104: 00010000:00010000:0.0:1788509583.645544:0:17160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.645638:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509583.645645:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.645663:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:2.0:1788509583.645667:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.645675:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788509583.645681:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509583.645686:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788509583.645726:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.645733:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788509583.645797:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796854912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509583.645834:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509583.645916:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.645925:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3000/0xe5156b86310dea1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509583.645943:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509583.645944:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509583.645946:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509583.647196:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796854912 00000100:00100000:3.0:1788509583.647205:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796854912 00010000:00010000:3.0:1788509583.647239:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dea1f expref: 12 pid: 17139 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509583.647266:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788509583.647274:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:3647:x1875387796854912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509583.647285:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509583.647290:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dea1f expref: 12 pid: 17139 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647302:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dea1f expref: 12 pid: 17139 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647316:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc87ce3400/0xe5156b86310dea26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dea1f expref: 12 pid: 17139 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647331:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647346:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788509583.647360:0:17129:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004845795s 00010000:00010000:3.0:1788509583.647365:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647373:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647380:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647386:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647391:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846fe00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509583.647395:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647403:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647416:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509583.647425:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509583.647666:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+11:3647:x1875387796854912:12345-0@lo:103:ldlm_bl.0 Request processed in 391us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509583.647673:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509583.647761:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796854912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509583.647890:0:17160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.647917:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509583.647924:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310dea57 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788509583.663951:0:17123:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788509583.664633:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788509583.664645:0:17183:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788509583.664650:0:17183:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788509583.665291:0:17184:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788509583.665320:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788509583.665888:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788509583.666877:0:17185:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8bcc87781f80 x1875387796855040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509583.666891:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00000040:01000000:3.0:1788509583.668319:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788509583.668368:0:17123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788509583.668831:0:17123:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788509583.668838:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788509583.668886:0:17123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509583.670290:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788509583.672733:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788509583.672805:0:17184:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788509583.673666:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788509583.673741:0:17123:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788509583.675554:0:17123:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788509583.681036:0:17123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788509583.683635:0:17123:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788509583.683667:0:17123:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb93b41a4b988 00100000:10000000:1.0:1788509583.683673:0:17123:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788509583.687672:0:17123:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788509583.687690:0:17123:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788509583.687710:0:17123:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788509583.687734:0:17123:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788509583.688541:0:17123:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788509583.688738:0:17123:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788509584.278382:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788509584.663988:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788509584.726978:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 10000000:01000000:3.0:1788509584.854113:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788509584.854119:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcc870ca000 from 7 10000000:01000000:3.0:1788509584.854123:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788509584.854166:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509584.854189:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509584.854202:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509584.854227:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796855168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788509584.854294:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509584.854360:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a024e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509584.854499:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796855168 00000100:00100000:1.0:1788509584.854507:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796855168 00000100:00100000:1.0:1788509584.854560:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788509584.854571:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+11:17142:x1875387796855168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509584.854583:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509584.854597:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dea5e expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509584.854620:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dea5e expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509584.854631:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea5e expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509584.854640:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae200, rc 0) 00000100:00100000:1.0:1788509584.854696:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17142:x1875387796855168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509584.854703:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788509584.855266:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796855168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509584.855283:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509584.855303:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509584.855348:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796855296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788509584.855378:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509584.855409:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a024e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509584.855460:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796855296 00000100:00100000:2.0:1788509584.855464:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796855296 00000100:00100000:2.0:1788509584.855497:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788509584.855504:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17142:x1875387796855296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788509584.855517:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788509584.855535:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788509584.855538:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788509584.855612:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17142:x1875387796855296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509584.855619:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788509584.855687:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796855296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788509584.855722:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788509584.855728:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509584.855736:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509585.302203:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788509585.690934:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788509585.768515:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:2.0:1788509586.327061:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509586.775950:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:3.0:1788509587.352752:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788509587.448675:0:17428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788509587.798104:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:2.0:1788509588.375047:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788509588.444637:0:17480:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509588.444789:0:17480:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1788509588.694952:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788509588.694958:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788509588.694961:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788509588.694970:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:3.0:1788509588.694975:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788509588.695020:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8bcdbbf08000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509588.695042:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd87c69180 x1875387796855552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788509588.695065:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788509588.695068:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788509588.695072:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788509588.695074:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788509588.695077:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788509588.695080:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788509588.695081:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcd913eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788509588.695087:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8bcd913eb800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509588.695099:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd87c68000 x1875387796855680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788509588.695159:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:830aae98-6419-4d90-97fb-7d4af2af47a0:3644:1875387796855424:0@lo:400:kworker.0 00000100:00100000:3.0:1788509588.695226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509588.695502:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796855552:0@lo:38:kworker.0 00000100:00100000:2.0:1788509588.695536:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509588.695563:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796855680:0@lo:38:kworker.0 00000100:00100000:2.0:1788509588.695588:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509588.695651:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796855424 00000100:00100000:2.0:1788509588.695659:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796855424 00000100:00100000:2.0:1788509588.695806:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509588.695827:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+12:3644:x1875387796855424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509588.695879:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+12:3644:x1875387796855424:12345-0@lo:400:kworker.0 Request processed in 54us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509588.695887:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509588.695953:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796855680 00000100:00100000:2.0:1788509588.695957:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796855680 00000100:00100000:2.0:1788509588.695975:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509588.695979:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796855680:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788509588.696001:0:17146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1788509588.696039:0:17146:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe5156b86310dea6c 00000004:00100000:2.0:1788509588.696055:0:17146:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788509588.696193:0:17146:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509588.696233:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875387796855680:12345-0@lo:38:kworker.0 Request processed in 252us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509588.696239:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788509588.696277:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bcd87c68000 x1875387796855680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788509588.696291:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788509588.696297:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788509588.696301:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788509588.696304:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd913eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788509588.696309:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875387796855680:0@lo:38:kworker.0 00000100:00100000:2.0:1788509588.696340:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:830aae98-6419-4d90-97fb-7d4af2af47a0:3644:1875387796855424:0@lo:400:kworker.0 00000100:00100000:3.0:1788509588.696717:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796855552 00000100:00100000:3.0:1788509588.696723:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796855552 00000100:00100000:3.0:1788509588.696751:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509588.696914:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875387796855552:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788509588.696928:0:17150:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788509588.716037:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875387796855552:12345-0@lo:38:kworker.0 Request processed in 19271us (20491us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788509588.716051:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788509588.716313:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509588.716320:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788509588.716325:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796855552:0@lo:38:kworker.0 00000100:00100000:0.0:1788509588.830733:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:3.0:1788509589.398400:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788509589.519164:0:17530:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509589.519479:0:17530:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788509589.846529:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:2.0:1788509590.424208:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509590.871041:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:1.0:1788509591.446121:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509591.895209:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:2.0:1788509592.475526:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509592.923398:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:1.0:1788509593.494121:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509593.817985:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509583/real 1788509583] req@ffff8bcc87783480 x1875387796852608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509593 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509593.818015:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87783480 x1875387796852608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509593 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509593.818038:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509583/real 1788509583] req@ffff8bcdb787c000 x1875387796852480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509593 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509593.818052:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcdb787c000 x1875387796852480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509593 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788509593.818090:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509593.818098:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788509593.818101:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796852608:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788509593.818106:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd9f604000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509593.818110:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788509593.818121:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796852480:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788509593.818377:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788509593.818382:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788509593.818385:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509593.818389:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:2.0:1788509593.818395:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788509593.818400:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8bcdbbf08000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509593.818423:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb787c700 x1875387796855936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788509593.818446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509593.818449:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788509593.818451:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcd9f604000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509593.818454:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1788509593.818456:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788509593.818459:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bcd9f604000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509593.818468:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb787ca80 x1875387796856064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788509593.818476:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509593.818479:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788509593.818480:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509593.818483:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1788509593.818485:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788509593.818487:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bcc810b5000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509593.818494:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb787ed80 x1875387796856192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509593.818553:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796856320:0@lo:400:kworker.0 00000100:00100000:2.0:1788509593.818608:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509593.818671:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796856320 00000100:00100000:2.0:1788509593.818678:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796856320 00000100:00100000:0.0:1788509593.818769:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796855808:0@lo:400:kworker.0 00000100:00100000:0.0:1788509593.818814:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509593.820130:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796855808 00000100:00100000:0.0:1788509593.820141:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796855808 00000100:00100000:0.0:1788509593.820209:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788509593.820220:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:3645:x1875387796855808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509593.820298:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+12:3645:x1875387796855808:12345-0@lo:400:kworker.0 Request processed in 80us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509593.820304:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788509593.820360:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796855808:0@lo:400:kworker.0 00000100:00100000:2.0:1788509593.823222:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788509593.823235:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796856320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509593.823331:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796856320:12345-0@lo:400:kworker.0 Request processed in 99us (4722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509593.823352:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788509593.823411:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bcdb787f100 x1875387796856320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509593.823426:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796856320:0@lo:400:kworker.0 00000100:00100000:2.0:1788509593.823470:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796855936:0@lo:38:kworker.0 00000100:00100000:2.0:1788509593.823518:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509593.823538:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796856064:0@lo:8:kworker.0 00000400:00000100:2.0:1788509593.823559:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796856064 offset 0 length 520: 4 00000100:00100000:2.0:1788509593.823570:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796856192:0@lo:8:kworker.0 00000400:00000100:2.0:1788509593.823583:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796856192 offset 0 length 520: 4 00000100:00100000:2.0:1788509593.823605:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796855936 00000100:00100000:2.0:1788509593.823611:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796855936 00000100:00100000:2.0:1788509593.823644:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788509593.823650:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875387796855936:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788509593.823668:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788509593.848472:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875387796855936:12345-0@lo:38:kworker.0 Request processed in 24813us (24946us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788509593.848487:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788509593.854525:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509593.854537:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788509593.854555:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796855936:0@lo:38:kworker.0 00000100:00100000:1.0:1788509593.942973:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:2.0:1788509594.519294:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509594.968375:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:3.0:1788509595.544232:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788509595.927059:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788509595.990001:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00000020:01000004:2.0:1788509596.286391:0:17875:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788509596.286395:0:17875:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788509596.286396:0:17875:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788509596.286503:0:17875:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bcd83147800 00000020:01000004:2.0:1788509596.286529:0:17875:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788509596.286541:0:17875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788509596.286555:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8bcdb46219c0) 00000020:00000080:2.0:1788509596.286571:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788509596.380513:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788509596.382550:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788509596.383770:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788509596.384307:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788509596.384505:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788509596.384687:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788509596.385495:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788509596.389521:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788509596.394397:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788509596.394707:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788509596.394992:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788509596.395453:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788509596.395708:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788509596.396309:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788509596.397932:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788509596.398695:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788509596.399394:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788509596.399634:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788509596.399834:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.400496:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.400746:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.403500:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.403867:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.404306:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.404581:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.404789:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.405086:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.405563:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.405800:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.406398:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.406661:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.406853:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.407489:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.407752:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.407991:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.408440:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.408631:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.409118:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.409482:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.409734:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.410330:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.410539:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.410859:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788509596.411425:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.411668:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788509596.411953:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00080000:01000000:3.0:1788509596.416809:0:17875:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788509596.417572:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788509596.417588:0:17875:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788509596.417607:0:17875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310dea7a 00000020:01000004:3.0:1788509596.417617:0:17875:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788509596.417643:0:17875:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788509596.417648:0:17875:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788509596.417654:0:17875:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788509596.417692:0:17875:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788509596.417699:0:17875:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788509596.426595:0:17875:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788509596.426655:0:17875:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788509596.426660:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788509596.426662:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788509596.426663:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509596.426664:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509596.426665:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509596.426666:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509596.426668:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788509596.426670:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509596.426671:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788509596.426675:0:17875:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788509596.426677:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788509596.426679:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788509596.426680:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509596.426681:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509596.426682:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509596.426683:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509596.426684:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788509596.426685:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509596.426686:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788509596.426721:0:17875:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788509596.426874:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856448:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788509596.427019:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.427087:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.427672:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796856448 00000100:00100000:2.0:1788509596.427689:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796856448 00000100:00100000:2.0:1788509596.428045:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788509596.428058:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17875:x1875387796856448:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788509596.428098:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788509596.428101:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788509596.428108:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788509596.435124:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17875:x1875387796856448:12345-0@lo:253:mount.lustre.0 Request processed in 7056us (8093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.435162:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788509596.435239:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856448:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788509596.435263:0:17875:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788509596.435267:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788509596.435269:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788509596.435270:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509596.435271:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509596.435273:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509596.435289:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509596.435290:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788509596.435292:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509596.435293:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788509596.435313:0:17875:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bcd83147800 from lustre-MDT0001 10000000:01000000:0.0:1788509596.435348:0:17875:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788509596.435351:0:17875:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788509596.435358:0:17875:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bcdb4623380 local copy 00010000:00010000:0.0:1788509596.435369:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509596.435472:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509596.437296:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509596.437475:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796856576 00000100:00100000:2.0:1788509596.437483:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796856576 00000100:00100000:2.0:1788509596.437541:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509596.437552:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17875:x1875387796856576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509596.437664:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17875:x1875387796856576:12345-0@lo:501:mount.lustre.0 Request processed in 113us (373us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509596.437671:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788509596.441660:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509596.441710:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856576:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788509596.441738:0:17875:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788509596.441799:0:17875:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788509596.441808:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.441819:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509596.441849:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bcd83147800 10000000:01000000:1.0:1788509596.441855:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788509596.441860:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8bcdb4623380 10000000:01000000:1.0:1788509596.441863:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788509596.441866:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8bcdb4623380 from 1 10000000:01000000:1.0:1788509596.441869:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788509596.441923:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862af400/0xe5156b86310dea81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.441933:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc862af400/0xe5156b86310dea81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.441957:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc862af400/0xe5156b86310dea81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509596.441981:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788509596.442044:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.442088:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842480 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.442256:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796856704 00000100:00100000:2.0:1788509596.442264:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796856704 00000100:00100000:2.0:1788509596.442318:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788509596.442328:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+12:17875:x1875387796856704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509596.442340:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509596.442351:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce3000/0xe5156b86310dea88 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dea81 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.442373:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce3000/0xe5156b86310dea88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dea81 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.442391:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce3000/0xe5156b86310dea88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea81 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.442400:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3000, rc 0) 00000100:00100000:2.0:1788509596.442440:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+13:17875:x1875387796856704:12345-0@lo:101:mount.lustre.0 Request processed in 113us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.442446:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788509596.442592:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509596.442606:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc862af400/0xe5156b86310dea81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea88 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.442616:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc862af400/0xe5156b86310dea81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dea88 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509596.442632:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788509596.442686:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862af400/0xe5156b86310dea81 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea88 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.442695:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc862af400/0xe5156b86310dea81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea88 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509596.442703:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8bcd83147800 10000000:01000000:1.0:1788509596.442707:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788509596.442711:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8bcd83147800 from 1 10000000:01000000:1.0:1788509596.442714:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788509596.442729:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862aec00/0xe5156b86310dea8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.442736:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc862aec00/0xe5156b86310dea8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.442750:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc862aec00/0xe5156b86310dea8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509596.442775:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788509596.442801:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.442823:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842480 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.443599:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796856832 00000100:00100000:3.0:1788509596.443606:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796856832 00000100:00100000:3.0:1788509596.443641:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509596.443648:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+13:17875:x1875387796856832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509596.443657:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509596.443669:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dea96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dea8f expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.443687:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dea96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dea8f expref: 14 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.443696:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8e00/0xe5156b86310dea96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea8f expref: 14 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.443702:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8e00, rc 0) 00000100:00100000:3.0:1788509596.443742:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+14:17875:x1875387796856832:12345-0@lo:101:mount.lustre.0 Request processed in 94us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.443748:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788509596.444026:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509596.444041:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc862aec00/0xe5156b86310dea8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea96 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.444049:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc862aec00/0xe5156b86310dea8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dea96 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509596.444064:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788509596.444392:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862aec00/0xe5156b86310dea8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea96 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.444402:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc862aec00/0xe5156b86310dea8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dea96 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509596.444410:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788509596.444415:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788509596.444421:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8bcd83147800 10000000:01000000:1.0:1788509596.444423:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788509596.444427:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788509596.444430:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788509596.444450:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862afe00/0xe5156b86310dea9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.444478:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc862afe00/0xe5156b86310dea9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.444487:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc862afe00/0xe5156b86310dea9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509596.444503:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788509596.444537:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.444568:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842480 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.444620:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796856960 00000100:00100000:3.0:1788509596.444625:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796856960 00000100:00100000:3.0:1788509596.444660:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788509596.444666:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+14:17875:x1875387796856960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509596.444674:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509596.444690:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9000/0xe5156b86310deaa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dea9d expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.444705:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9000/0xe5156b86310deaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dea9d expref: 15 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.444714:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9000/0xe5156b86310deaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea9d expref: 15 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.444721:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9000, rc 0) 00000100:00100000:3.0:1788509596.444773:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+15:17875:x1875387796856960:12345-0@lo:101:mount.lustre.0 Request processed in 107us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.444780:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788509596.444889:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796856960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509596.444931:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc862afe00/0xe5156b86310dea9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deaa4 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.444940:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc862afe00/0xe5156b86310dea9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310deaa4 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788509596.448456:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788509596.451072:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788509596.458698:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788509596.458756:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788509596.458785:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788509596.458799:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788509596.458813:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788509596.458830:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788509596.458842:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788509596.458855:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788509596.458869:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788509596.458882:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788509596.458930:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788509596.458947:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788509596.458961:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788509596.458974:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788509596.458986:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788509596.458999:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788509596.459012:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788509596.459024:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788509596.459035:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788509596.459046:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788509596.459057:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788509596.459067:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788509596.459078:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788509596.459104:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788509596.459109:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788509596.460436:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796857088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788509596.460659:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.460778:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842180 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.463873:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796857088 00000100:00100000:2.0:1788509596.463887:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796857088 00000100:00100000:2.0:1788509596.463966:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788509596.463981:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+15:17875:x1875387796857088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788509596.464422:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796857088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788509596.464484:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796857216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788509596.464709:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.464748:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842180 going to sleep for 11 seconds 00000100:00100000:0.0:1788509596.464821:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796857216 00000100:00100000:0.0:1788509596.464826:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796857216 00000100:00100000:0.0:1788509596.464862:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788509596.464870:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+16:17875:x1875387796857216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509596.465880:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+16:17875:x1875387796857216:12345-0@lo:503:mount.lustre.0 Request processed in 1008us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509596.465889:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788509596.465998:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+15:17875:x1875387796857088:12345-0@lo:501:mount.lustre.0 Request processed in 199us (3519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.466009:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788509596.466094:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796857216:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788509596.468711:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788509596.468838:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796857344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509596.472379:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.472438:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.472522:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796857344 00000100:00100000:2.0:1788509596.472532:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796857344 00000100:00100000:2.0:1788509596.472587:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788509596.472597:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+15:17875:x1875387796857344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509596.474616:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+15:17875:x1875387796857344:12345-0@lo:502:mount.lustre.0 Request processed in 2014us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.474628:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788509596.478959:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796857344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788509596.480189:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788509596.480234:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788509596.480249:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788509596.480263:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788509596.480276:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788509596.480287:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788509596.480298:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788509596.480310:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788509596.480322:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788509596.480335:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788509596.480361:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788509596.480500:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788509596.480515:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788509596.480528:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788509596.480539:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788509596.480550:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788509596.480561:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788509596.480573:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788509596.480587:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788509596.480599:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788509596.480614:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788509596.480626:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788509596.480638:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788509596.480652:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788509596.481456:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788509596.481480:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788509596.481495:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788509596.481509:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788509596.481523:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788509596.481533:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788509596.481543:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788509596.481555:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788509596.481567:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788509596.481579:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788509596.481593:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788509596.481606:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788509596.481618:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788509596.481633:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788509596.481646:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788509596.482280:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788509596.482309:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788509596.482324:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788509596.482359:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788509596.482466:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788509596.482517:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796857472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509596.482593:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.482695:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.482978:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796857472 00000100:00100000:2.0:1788509596.482986:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796857472 00000100:00100000:2.0:1788509596.483078:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788509596.483088:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+15:17875:x1875387796857472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509596.483234:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+15:17875:x1875387796857472:12345-0@lo:502:mount.lustre.0 Request processed in 146us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.483248:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788509596.483337:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796857472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788509596.483397:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788509596.483405:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788509596.484463:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509596.484475:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509596.484478:0:17879:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788509596.484483:0:17879:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788509596.484486:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788509596.484499:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8bcc870f3380) 00000020:00000080:3.0:1788509596.484519:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788509596.484524:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788509596.484587:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788509596.484592:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310deab2 00000020:00000080:3.0:1788509596.484811:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788509596.484815:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509596.484819:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509596.484820:0:17879:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788509596.484823:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509596.484826:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509596.484827:0:17879:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788509596.484830:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788509596.484837:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8bcc870f0000) 00000020:00000080:3.0:1788509596.484847:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788509596.484851:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788509596.484852:0:17879:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788509596.484855:0:17879:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788509596.484861:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788509596.484940:0:17879:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcd83147800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788509596.484959:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8bcd97e70000) 00000020:00000080:3.0:1788509596.484977:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788509596.485047:0:17879:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788509596.485053:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310deac7 00000020:00000080:3.0:1788509596.485635:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788509596.485644:0:17879:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788509596.485649:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe5156b86310deace 00080000:01000000:3.0:1788509596.485668:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788509596.485673:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310dead5 00010000:00010000:2.0:1788509596.568297:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509596.575208:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788509596.576322:0:17879:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788509596.577261:0:17879:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788509596.581550:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788509596.581566:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509596.581573:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.581576:0:17879:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788509596.581580:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509596.581588:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.581589:0:17879:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788509596.581592:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788509596.581606:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:1.0:1788509596.581635:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788509596.581653:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8bcc86303380) 00000020:00000080:1.0:1788509596.581674:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788509596.581680:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788509596.581753:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788509596.581772:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788509596.581778:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310deae3 00010000:00080000:1.0:1788509596.581808:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcd89114800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509596.585594:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788509596.599805:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788509596.599823:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788509596.599884:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788509596.600178:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310deaea 00000100:00080000:2.0:1788509596.600189:0:17879:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788509596.600195:0:17879:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8bcd89114800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509596.600232:0:17879:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb787f480 x1875387796857600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509596.600295:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796857600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788509596.600408:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.600496:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796857600 00000100:00100000:1.0:1788509596.600503:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796857600 00000100:00100000:1.0:1788509596.600545:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509596.600553:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875387796857600:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788509596.600577:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1788509596.600608:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310deaf1 00000004:00100000:1.0:1788509596.600622:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788509596.600628:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788509596.600711:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788509596.600844:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509596.600848:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509596.600850:0:17879:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788509596.600853:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788509596.600856:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788509596.600858:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788509596.600860:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788509596.600861:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788509596.600864:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509596.600865:0:17879:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788509596.600867:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509596.600871:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509596.600872:0:17879:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788509596.600875:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788509596.600932:0:17879:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788509596.600946:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509596.600950:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509596.600951:0:17879:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788509596.600954:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788509596.600964:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788509596.600965:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788509596.600967:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788509596.600969:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788509596.600971:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509596.600973:0:17879:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788509596.600976:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788509596.600979:0:17879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788509596.600982:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509596.600983:0:17879:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788509596.600986:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788509596.600989:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1788509596.601009:0:17879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788509596.601012:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788509596.601027:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8bcdb0e20000) 00000020:00000080:2.0:1788509596.601039:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788509596.601044:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788509596.601217:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788509596.601223:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788509596.601229:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310deaff 00010000:00080000:2.0:1788509596.601256:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcd91375800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788509596.601458:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1788509596.602440:0:17879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788509596.604057:0:17879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788509596.606707:0:17879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509596.607011:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788509596.607139:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:1.0:1788509596.608218:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788509596.608224:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788509596.608228:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509596.608235:0:485:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:1.0:1788509596.608241:0:485:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788509596.608248:0:485:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8bcdbbf08000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509596.608282:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87354380 x1875387796857728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509596.608311:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509596.608323:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509596.608326:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509596.608329:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788509596.608385:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796857856:0@lo:400:kworker.0 00000100:00100000:1.0:1788509596.608456:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509596.608564:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796857728:0@lo:38:kworker.0 00000100:00100000:0.0:1788509596.608598:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788509596.608873:0:17884:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788509596.608877:0:17884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788509596.609088:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796857856 00000100:00100000:2.0:1788509596.609104:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796857856 00000100:00100000:2.0:1788509596.609180:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509596.609191:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796857856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509596.609249:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796857856:12345-0@lo:400:kworker.0 Request processed in 61us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.609257:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788509596.609309:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bcc87354e00 x1875387796857856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509596.609322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796857856:0@lo:400:kworker.0 00000100:00100000:1.0:1788509596.609861:0:17149:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788509596.609869:0:17149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:00000080:0.0:1788509596.610846:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788509596.610861:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788509596.610949:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788509596.610973:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310deb06 00000100:00080000:0.0:1788509596.610981:0:17879:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788509596.610987:0:17879:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8bcd91375800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509596.611021:0:17879:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87780000 x1875387796857984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788509596.611048:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788509596.611199:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796857728 00000100:00100000:3.0:1788509596.611205:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796857728 00000100:00100000:3.0:1788509596.611289:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509596.611297:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875387796857728:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788509596.611373:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875387796857728:12345-0@lo:38:kworker.0 Request processed in 74us (2773us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788509596.611380:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509596.611603:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796857984:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788509596.611639:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796857984 offset 0 length 520: 4 00000100:00100000:1.0:1788509596.611679:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788509596.611686:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788509596.611691:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788509596.611694:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796857728:0@lo:38:kworker.0 00000100:00080000:1.0:1788509596.611722:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509596.611726:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509596.611729:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509596.611731:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788509596.612918:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509596.612929:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509596.612932:0:17879:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788509596.612939:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788509596.612942:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788509596.612944:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788509596.612945:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788509596.612946:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788509596.612949:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509596.612950:0:17879:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788509596.612953:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788509596.612957:0:17879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788509596.612961:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509596.612962:0:17879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788509596.612965:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788509596.612970:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:0.0:1788509596.612997:0:17879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788509596.612999:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788509596.613016:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8bcd9e5d8000) 00000020:00000080:0.0:1788509596.613038:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788509596.613045:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788509596.613128:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788509596.613135:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788509596.613141:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe5156b86310deb14 00010000:00080000:0.0:1788509596.613171:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcdb47be800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788509596.613402:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788509596.613480:0:17879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788509596.613495:0:17879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788509596.614394:0:17150:0:(import.c:65:import_set_state_nolock()) ffff8bcd91374000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509596.617979:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875387796857600:12345-0@lo:38:llog_process_th.0 Request processed in 17415us (17560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.617994:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:3.0:1788509596.622578:0:17879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509596.622798:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788509596.622950:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788509596.623401:0:17887:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788509596.623405:0:17887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788509596.624050:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788509596.624063:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788509596.624114:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788509596.624137:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310deb1b 00000100:00080000:0.0:1788509596.624149:0:17879:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788509596.624155:0:17879:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8bcdb47be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509596.624203:0:17879:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87782300 x1875387796858112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788509596.624220:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788509596.624280:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509596.624284:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509596.624286:0:17879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788509596.624290:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509596.624294:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509596.624295:0:17879:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788509596.624298:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788509596.624300:0:17879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788509596.624303:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509596.624305:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509596.624306:0:17879:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788509596.624309:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509596.624311:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509596.624312:0:17879:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788509596.624316:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788509596.624341:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509596.624344:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509596.624346:0:17879:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788509596.624348:0:17879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:2.0:1788509596.624570:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509596.624575:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509596.624578:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509596.624580:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788509596.624653:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788509596.624685:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788509596.624706:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862afe00/0xe5156b86310dea9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deaa4 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.624729:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc862afe00/0xe5156b86310dea9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deaa4 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509596.624738:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd83147800 from 1 10000000:01000000:3.0:1788509596.624741:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788509596.624777:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.624786:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.624797:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509596.624818:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788509596.624886:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.624940:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6367900 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.625000:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796858240 00000100:00100000:2.0:1788509596.625007:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796858240 00000100:00100000:2.0:1788509596.625061:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788509596.625070:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+15:17875:x1875387796858240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509596.625083:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509596.625107:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310deb22 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.625130:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310deb22 expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.625141:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb22 expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.625149:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2000, rc 0) 00000100:00100000:2.0:1788509596.625199:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+16:17875:x1875387796858240:12345-0@lo:101:mount.lustre.0 Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.625206:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788509596.625254:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509596.625268:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.625277:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509596.625823:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858368:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788509596.625894:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509596.625945:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.625962:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796858368 00000100:00100000:2.0:1788509596.625967:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796858368 00000100:00100000:2.0:1788509596.625992:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788509596.625998:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+16:17875:x1875387796858368:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788509596.626013:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788509596.626029:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788509596.626032:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788509596.626119:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+16:17875:x1875387796858368:12345-0@lo:256:mount.lustre.0 Request processed in 120us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.626126:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788509596.626163:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858368:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788509596.626717:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788509596.626727:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.626749:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509596.626770:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd83147800 from 1 10000000:01000000:2.0:1788509596.626773:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788509596.626797:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.626805:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.626814:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509596.626831:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788509596.626866:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509596.626886:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.626927:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796858496 00000100:00100000:2.0:1788509596.626932:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796858496 00000100:00100000:2.0:1788509596.626960:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788509596.626967:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+16:17875:x1875387796858496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509596.626975:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509596.626985:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310deb30 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.627002:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310deb30 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.627021:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb30 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.627028:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2c00, rc 0) 00000100:00100000:2.0:1788509596.627060:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796858496:12345-0@lo:101:mount.lustre.0 Request processed in 94us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.627065:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788509596.627118:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509596.627132:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.627140:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788509596.627266:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788509596.627294:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509596.627320:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509596.627333:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6363300 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.627345:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796858624 00000100:00100000:2.0:1788509596.627348:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796858624 00000100:00100000:2.0:1788509596.627368:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788509596.627374:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796858624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509596.627445:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796858624:12345-0@lo:501:mount.lustre.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.627452:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788509596.627484:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509596.627513:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788509596.627583:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509596.627596:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6363300 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.627608:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796858752 00000100:00100000:2.0:1788509596.627611:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796858752 00000100:00100000:2.0:1788509596.627631:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788509596.627637:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796858752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788509596.627706:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796858752:12345-0@lo:503:mount.lustre.0 Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.627713:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788509596.627752:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858752:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788509596.628108:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788509596.628176:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509596.628210:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509596.628225:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6363d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.628239:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796858880 00000100:00100000:2.0:1788509596.628243:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796858880 00000100:00100000:2.0:1788509596.628275:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788509596.628281:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796858880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509596.628346:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796858880:12345-0@lo:502:mount.lustre.0 Request processed in 65us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.628352:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788509596.628389:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796858880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788509596.628587:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788509596.628608:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1788509596.628627:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1788509596.628638:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1788509596.628648:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1788509596.628659:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788509596.628675:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1788509596.628686:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1788509596.628696:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788509596.628705:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1788509596.628716:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1788509596.628733:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509596.633042:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.633255:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788509596.633268:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788509596.633277:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788509596.633282:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788509596.633286:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd89114800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788509596.633304:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796857600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788509596.633355:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796858112:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788509596.633401:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796858112 offset 0 length 520: 4 00000100:00100000:0.0:1788509596.633801:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796859136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509596.633843:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.634036:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796859136 00000100:00100000:1.0:1788509596.634043:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796859136 00000100:00100000:1.0:1788509596.634102:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788509596.634112:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796859136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788509596.634144:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788509596.634191:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875387796859136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509596.634198:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509596.634326:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796859136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509596.635210:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796859008 00000100:00100000:3.0:1788509596.635217:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796859008 00000100:00100000:3.0:1788509596.635299:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788509596.635308:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796859008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509596.635437:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796859008:12345-0@lo:502:mount.lustre.0 Request processed in 131us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.635446:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788509596.635570:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6363d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509596.635586:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788509596.635665:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1788509596.635679:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788509596.636286:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509596.636297:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.636300:0:17889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788509596.636307:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcd83147800 00000020:00000080:1.0:1788509596.636309:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509596.636316:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509596.636319:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.636320:0:17889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788509596.636322:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509596.636325:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.636326:0:17889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788509596.636329:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcd83147800 00000020:00000080:1.0:1788509596.636331:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509596.636385:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509596.636389:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.636390:0:17889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788509596.636393:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509596.636395:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.636396:0:17889:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509596.636400:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcd83147800 00000020:00000080:1.0:1788509596.636407:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509596.636427:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509596.636430:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.636432:0:17889:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788509596.636434:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788509596.636437:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.636438:0:17889:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788509596.636441:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcd83147800 00000020:00000080:1.0:1788509596.636443:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788509596.636464:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788509596.636467:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788509596.636469:0:17889:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788509596.636471:0:17889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788509596.639206:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788509596.639242:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509596.639261:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509596.639273:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509596.639331:0:17875:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788509596.639334:0:17875:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bcd83147800 10000000:01000000:0.0:1788509596.639336:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bcd83147800 10000000:01000000:0.0:1788509596.639340:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788509596.639344:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd83147800 from 1 10000000:01000000:0.0:1788509596.639347:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788509596.639378:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f200/0xe5156b86310deb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509596.639386:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f200/0xe5156b86310deb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509596.639396:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f200/0xe5156b86310deb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509596.639418:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788509596.639480:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509596.639505:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea780 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.639770:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796859264 00000100:00100000:3.0:1788509596.639777:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796859264 00000100:00100000:2.0:1788509596.647278:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788509596.647292:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796859264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509596.647309:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509596.647333:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce3600/0xe5156b86310deb45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310deb3e expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.647361:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce3600/0xe5156b86310deb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310deb3e expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.647373:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce3600/0xe5156b86310deb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb3e expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.647382:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3600, rc 0) 00000100:00100000:2.0:1788509596.647458:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859264:12345-0@lo:101:mount.lustre.0 Request processed in 169us (7978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.647471:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788509596.647531:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509596.647550:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f200/0xe5156b86310deb3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb45 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509596.647560:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f200/0xe5156b86310deb3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310deb45 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788509596.661129:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788509596.661415:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509596.661629:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788509596.661654:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788509596.661669:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788509596.661683:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788509596.661696:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788509596.661708:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788509596.661719:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788509596.661731:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788509596.661743:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788509596.661755:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788509596.661781:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788509596.661794:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788509596.661807:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788509596.661819:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788509596.661847:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788509596.661863:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788509596.661875:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788509596.661887:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788509596.661930:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788509596.661947:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788509596.661962:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788509596.661974:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788509596.661986:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788509596.662001:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788509596.662015:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788509596.662029:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788509596.662043:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788509596.662058:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788509596.662080:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788509596.662086:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788509596.662172:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509596.662245:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509596.662283:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.662445:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796859392 00000100:00100000:3.0:1788509596.662453:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796859392 00000100:00100000:3.0:1788509596.662502:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788509596.662511:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509596.662626:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859392:12345-0@lo:501:mount.lustre.0 Request processed in 115us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.662633:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788509596.664950:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509596.665011:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509596.665078:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.665199:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796859520 00000100:00100000:3.0:1788509596.665205:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796859520 00000100:00100000:3.0:1788509596.665253:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788509596.665262:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788509596.671361:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859520:12345-0@lo:503:mount.lustre.0 Request processed in 6091us (6273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.671377:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788509596.671532:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1788509596.671560:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859520:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788509596.672029:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788509596.673229:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788509596.673298:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509596.673338:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.673798:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796859648 00000100:00100000:3.0:1788509596.673805:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796859648 00000100:00100000:3.0:1788509596.673857:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788509596.673866:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509596.674032:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859648:12345-0@lo:502:mount.lustre.0 Request processed in 167us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.674040:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788509596.674284:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788509596.674527:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788509596.674558:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788509596.674573:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788509596.674585:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788509596.674599:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788509596.674611:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788509596.674624:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788509596.674636:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788509596.674649:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788509596.674663:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788509596.674678:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788509596.674693:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788509596.674707:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788509596.674722:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788509596.674736:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788509596.674748:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788509596.676791:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1788509596.676826:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788509596.676849:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788509596.676862:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788509596.678222:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788509596.678255:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788509596.678270:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788509596.678283:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788509596.678296:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788509596.678310:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788509596.678323:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788509596.678336:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788509596.678349:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788509596.678363:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788509596.678376:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788509596.678391:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788509596.678424:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788509596.678439:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788509596.678452:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788509596.678466:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788509596.678479:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788509596.678493:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788509596.678506:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788509596.678520:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788509596.678532:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788509596.678543:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788509596.678555:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788509596.678567:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788509596.678580:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788509596.678594:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788509596.678606:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788509596.678618:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788509596.678689:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788509596.678780:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.678832:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf8423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.679002:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796859776 00000100:00100000:3.0:1788509596.679009:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796859776 00000100:00100000:3.0:1788509596.679066:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788509596.679075:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509596.679308:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859776:12345-0@lo:502:mount.lustre.0 Request processed in 234us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.679317:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788509596.679488:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788509596.679682:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1788509596.679706:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1788509596.679732:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788509596.679780:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509596.679811:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.679858:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796859904 00000100:00100000:3.0:1788509596.679863:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796859904 00000100:00100000:3.0:1788509596.679895:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788509596.679926:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509596.680001:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796859904:12345-0@lo:502:mount.lustre.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.680007:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788509596.680048:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796859904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788509596.680091:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788509596.680277:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788509596.683139:0:17895:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788509596.683158:0:17895:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8bcd9e5db380) 00000020:00000080:0.0:1788509596.683181:0:17895:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788509596.683275:0:17895:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcd83147800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788509596.683279:0:17895:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcd83147800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788509596.683282:0:17895:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd83147800 3 00010000:00080000:0.0:1788509596.683312:0:17895:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcd89112000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788509596.684949:0:17895:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788509596.685151:0:17895:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788509596.685198:0:17895:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788509596.685212:0:17895:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe5156b86310deb53 00000100:00080000:0.0:1788509596.685220:0:17895:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788509596.685226:0:17895:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8bcd89112000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788509596.685262:0:17895:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87782d80 x1875387796860032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509596.685306:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875387796860032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788509596.685370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509596.685429:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796860032 00000100:00100000:0.0:1788509596.685436:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796860032 00000100:00100000:0.0:1788509596.685473:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509596.685480:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875387796860032:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788509596.685504:0:17146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:0.0:1788509596.685531:0:17146:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe5156b86310deb5a 00000004:00100000:0.0:1788509596.685547:0:17146:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788509596.685576:0:17146:0:(import.c:65:import_set_state_nolock()) ffff8bcdbd317800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509596.685624:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875387796860032:12345-0@lo:38:llog_process_th.0 Request processed in 142us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509596.685632:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788509596.685666:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bcc87782d80 x1875387796860032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509596.685677:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509596.685684:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788509596.685690:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788509596.685693:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788509596.685695:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd89112000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788509596.685707:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875387796860032:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788509596.685728:0:17895:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788509596.687316:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509596.687324:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509596.687326:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509596.687329:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788509596.689520:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788509596.691450:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788509596.691488:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509596.691512:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f200/0xe5156b86310deb3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb45 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.691525:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f200/0xe5156b86310deb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb45 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788509596.691578:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788509596.691580:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788509596.691582:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509596.691583:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509596.691584:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509596.691585:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509596.691586:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788509596.691588:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509596.691589:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788509596.691593:0:17875:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788509596.691595:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788509596.691597:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788509596.691598:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509596.691599:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509596.691605:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509596.691606:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509596.691607:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788509596.691608:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509596.691609:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788509596.691634:0:17875:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788509596.691655:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796860160:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788509596.691722:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.691778:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87767b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.691803:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796860160 00000100:00100000:3.0:1788509596.691811:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796860160 00000100:00100000:3.0:1788509596.691855:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788509596.691863:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17875:x1875387796860160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788509596.691887:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788509596.691922:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788509596.693744:0:17124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788509596.693809:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788509596.693851:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788509596.693984:0:17160:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788509596.693989:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788509596.694011:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.694036:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea5e expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.694044:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb22 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.694051:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.694087:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310deb22 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.694100:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310deb22 expref: 18 pid: 17139 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509596.694113:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796860288:0@lo:104: 00000100:00100000:1.0:1788509596.694168:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509596.694214:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dea5e expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.694222:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dea5e expref: 18 pid: 17138 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509596.694230:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796860416:0@lo:104: 00000100:00100000:1.0:1788509596.694251:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509596.694281:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf842a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509596.694355:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796860288 00000100:00100000:0.0:1788509596.694362:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796860288 00000100:00100000:0.0:1788509596.694393:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796860416 00000100:00100000:0.0:1788509596.694396:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796860416 00000100:00100000:0.0:1788509596.694408:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509596.694415:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:17160:x1875387796860288:12345-0@lo:104: 00010000:00010000:0.0:1788509596.694428:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509596.694477:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509596.694483:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:17160:x1875387796860288:12345-0@lo:104: Request processed in 68us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509596.694489:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509596.694505:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509596.694511:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:17160:x1875387796860416:12345-0@lo:104: 00010000:00010000:0.0:1788509596.694519:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509596.694549:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788509596.694554:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:17160:x1875387796860416:12345-0@lo:104: Request processed in 45us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509596.694560:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509596.694592:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796860288:0@lo:104: 00000100:00100000:0.0:1788509596.694610:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796860416:0@lo:104: 00010000:00010000:0.0:1788509596.694628:0:17160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694732:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788509596.694739:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694746:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8a00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509596.694750:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694769:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788509596.694776:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509596.694782:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788509596.694822:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694829:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509596.694849:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694856:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8a00/0xe5156b86310deb22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb29 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694868:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509596.694871:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694876:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509596.694879:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694884:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788509596.694890:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509596.694914:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788509596.694927:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694933:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509596.694946:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694963:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8400/0xe5156b86310dea5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea65 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.694974:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509596.694976:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509596.694978:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509596.694990:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796860544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509596.695023:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.695058:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796860544 00000100:00100000:3.0:1788509596.695063:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796860544 00010000:00010000:3.0:1788509596.695081:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb22 expref: 19 pid: 17139 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509596.695102:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509596.695109:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+19:3645:x1875387796860544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509596.695120:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509596.695125:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb22 expref: 19 pid: 17139 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.695135:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310deb22 expref: 19 pid: 17139 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.695148:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310deb22 expref: 19 pid: 17139 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509596.695157:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509596.695186:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+18:3645:x1875387796860544:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509596.695202:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788509596.695286:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796860544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509596.695448:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17875:x1875387796860160:12345-0@lo:253:mount.lustre.0 Request processed in 3584us (3724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509596.695457:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788509596.695541:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:17875:1875387796860160:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788509596.695552:0:17875:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788509596.695555:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788509596.695556:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788509596.695557:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509596.695558:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509596.695560:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509596.695561:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509596.695562:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788509596.695564:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509596.695565:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788509596.695575:0:17875:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788509596.696972:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796860672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509596.697035:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509596.697100:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509596.697158:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796860672 00000100:00100000:1.0:1788509596.697166:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796860672 00010000:00010000:1.0:1788509596.697198:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dea5e expref: 17 pid: 17138 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509596.697235:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509596.697243:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+17:3646:x1875387796860672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509596.697255:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509596.697260:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dea5e expref: 17 pid: 17138 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697270:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dea5e expref: 17 pid: 17138 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697286:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dea65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dea5e expref: 17 pid: 17138 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697302:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697310:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788509596.697325:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004845795s 00010000:00010000:1.0:1788509596.697331:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697351:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697359:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697365:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697372:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509596.697376:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697385:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697398:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509596.697408:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509596.697442:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+16:3646:x1875387796860672:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509596.697449:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509596.697518:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796860672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509596.697545:0:17160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509596.697553:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509596.697559:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc862ae000/0xe5156b86310deb61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1788509596.706534:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788509596.706788:0:17901:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788509596.707208:0:17901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788509596.708241:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788509596.711359:0:17901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788509596.711439:0:17901:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788509596.712740:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875387796860800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788509596.712824:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509596.712859:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796860800 00000100:00100000:2.0:1788509596.712866:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796860800 00000100:00100000:2.0:1788509596.713044:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509596.713054:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17902:x1875387796860800:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788509596.713126:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17902:x1875387796860800:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509596.713134:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:2.0:1788509596.713261:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788509596.713298:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788509596.713703:0:17875:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788509596.713711:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788509596.713756:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788509596.714400:0:17900:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788509596.714405:0:17900:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788509596.717173:0:17875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788509596.717703:0:17875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788509596.717733:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788509596.717850:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788509596.718203:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc865a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509596.718251:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875387796860800:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788509596.718286:0:17902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788509596.718332:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875387796860928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788509596.718396:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.718431:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb054a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509596.718487:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796860928 00000100:00100000:0.0:1788509596.718494:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796860928 00000100:00100000:0.0:1788509596.718546:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509596.718555:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17902:x1875387796860928:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788509596.718674:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17902:x1875387796860928:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 121us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509596.718681:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788509596.718747:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875387796860928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788509596.718814:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17902:1875387796861056:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788509596.718842:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.718881:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb054a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788509596.719013:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796861056 00000100:00100000:0.0:1788509596.719018:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796861056 00000100:00100000:0.0:1788509596.719043:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509596.719058:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17902:x1875387796861056:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788509596.719116:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17902:x1875387796861056:12345-0@lo:900:lod0001_rec0000.0 Request processed in 59us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509596.719123:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788509596.719272:0:17902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bcd87c69f80 x1875387796861056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788509612 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509596.719282:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17902:1875387796861056:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788509596.719319:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875387796861184:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788509596.719344:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509596.719368:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb054a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509596.719408:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796861184 00000100:00100000:1.0:1788509596.719413:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796861184 00000100:00100000:1.0:1788509596.719445:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509596.719452:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17902:x1875387796861184:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788509596.719523:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17902:x1875387796861184:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509596.719530:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788509596.719582:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17902:1875387796861184:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788509596.719618:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788509596.722674:0:17875:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1788509596.723219:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788509596.723277:0:17902:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788509596.723282:0:17902:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1788509596.724548:0:17875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788509596.732282:0:17875:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788509596.732320:0:17875:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb93b41a07988 00100000:10000000:3.0:1788509596.732329:0:17875:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788509596.733516:0:17875:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788509596.733547:0:17875:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788509596.733563:0:17875:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788509596.733586:0:17875:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788509596.734547:0:17875:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509596.734817:0:17875:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788509597.014004:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:3.0:1788509597.592291:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788509597.729404:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788509598.038132:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 10000000:01000000:1.0:1788509598.422288:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788509598.422294:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd83147800 from 8 10000000:01000000:1.0:1788509598.422299:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788509598.422346:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509598.422358:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509598.422368:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509598.422392:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796861312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788509598.422459:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509598.422516:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509598.422626:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796861312 00000100:00100000:0.0:1788509598.422634:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796861312 00000100:00100000:0.0:1788509598.422694:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788509598.422703:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+16:17142:x1875387796861312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509598.422715:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509598.422728:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310deb68 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509598.422759:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310deb68 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509598.422770:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb68 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509598.422779:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846fc00, rc 0) 00000100:00100000:0.0:1788509598.422824:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796861312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509598.422831:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788509598.422996:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796861312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509598.423011:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509598.423021:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509598.423072:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796861440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788509598.423103:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509598.423121:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002600 going to sleep for 11 seconds 00000100:00100000:3.0:1788509598.423179:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796861440 00000100:00100000:3.0:1788509598.423183:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796861440 00000100:00100000:3.0:1788509598.423214:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788509598.423221:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796861440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788509598.423234:0:17139:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788509598.423249:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788509598.423255:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788509598.423325:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796861440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509598.423331:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788509598.423407:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796861440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788509598.423448:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788509598.423455:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509598.423463:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509598.423471:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788509598.423473:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcc870ca000 from 8 10000000:01000000:1.0:1788509598.423476:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788509598.423491:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509598.423509:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509598.423518:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509598.423531:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796861568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788509598.423556:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509598.423574:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002600 going to sleep for 11 seconds 00000100:00100000:3.0:1788509598.423682:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796861568 00000100:00100000:3.0:1788509598.423686:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796861568 00000100:00100000:3.0:1788509598.423716:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788509598.423723:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd827f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796861568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509598.423730:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509598.423739:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310deb76 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509598.423763:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310deb76 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509598.423771:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb76 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509598.423778:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8400, rc 0) 00000100:00100000:3.0:1788509598.423805:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd827f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17142:x1875387796861568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509598.423811:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788509598.423960:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796861568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788509598.423972:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509598.423980:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509598.424030:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796861696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788509598.424056:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509598.424071:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002600 going to sleep for 11 seconds 00000100:00100000:0.0:1788509598.424310:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796861696 00000100:00100000:0.0:1788509598.424315:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796861696 00000100:00100000:0.0:1788509598.424352:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788509598.424359:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17142:x1875387796861696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788509598.424371:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788509598.424383:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788509598.424391:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788509598.424472:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17142:x1875387796861696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509598.424479:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788509598.424586:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796861696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788509598.424624:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788509598.424630:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509598.424639:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509598.614055:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788509598.743969:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788509599.062963:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:1.0:1788509599.638045:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509600.086103:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00010000:00010000:0.0:1788509600.661991:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509601.114612:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 0 seconds 00000001:02000400:1.0:1788509601.248705:0:18144:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788509601.686082:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788509602.008339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788509602.008347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788509602.008351:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788509602.008364:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8bcdbbf08000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509602.008388:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd87c6b100 x1875387796861952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788509602.008416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788509602.008420:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788509602.008423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788509602.008425:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788509602.008454:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788509602.008457:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788509602.008460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788509602.008463:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788509602.008489:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796861952:0@lo:38:kworker.0 00000100:00100000:3.0:1788509602.008552:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509602.008625:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796862080:0@lo:400:kworker.0 00000100:00100000:3.0:1788509602.008653:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509602.008673:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509602.008679:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796862208:0@lo:400:kworker.0 00000100:00100000:3.0:1788509602.008701:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509602.008746:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796861952 00000100:00100000:3.0:1788509602.008754:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796861952 00000100:00100000:3.0:1788509602.008781:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796862208 00000100:00100000:3.0:1788509602.008784:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796862208 00000100:00100000:3.0:1788509602.008810:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788509602.008818:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875387796861952:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788509602.008843:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1788509602.008879:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310deb84 00000004:00100000:3.0:1788509602.008922:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788509602.008928:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788509602.008996:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796862080 00000100:00100000:3.0:1788509602.009001:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796862080 00000100:00100000:3.0:1788509602.009029:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509602.009036:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796862080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509602.009097:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796862080:12345-0@lo:400:kworker.0 Request processed in 61us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509602.009104:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509602.009127:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788509602.009135:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796862208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509602.009165:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796862208:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509602.009171:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788509602.009210:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796862208:0@lo:400:kworker.0 00010000:00080000:3.0:1788509602.009222:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd87c6b800 x1875387796862080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509602.009232:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796862080:0@lo:400:kworker.0 00000100:00100000:2.0:1788509602.009424:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796861824:0@lo:400:kworker.0 00000100:00100000:2.0:1788509602.009463:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509602.009496:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509602.009502:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796862336:0@lo:400:kworker.0 00000100:00100000:2.0:1788509602.009527:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509602.009551:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796862336 00000100:00100000:2.0:1788509602.009555:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796862336 00000100:00100000:2.0:1788509602.009588:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788509602.009595:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796862336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509602.009633:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796862336:12345-0@lo:400:kworker.0 Request processed in 39us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509602.009639:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788509602.009665:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd87c6ad80 x1875387796862336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509602.009674:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796862336:0@lo:400:kworker.0 00000100:00100000:3.0:1788509602.009766:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796861824 00000100:00100000:3.0:1788509602.009770:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796861824 00000100:00100000:3.0:1788509602.009808:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788509602.009816:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:3647:x1875387796861824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509602.009856:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:3647:x1875387796861824:12345-0@lo:400:kworker.0 Request processed in 41us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509602.009862:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788509602.009923:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796861824:0@lo:400:kworker.0 00000100:00100000:0.0:1788509602.011768:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788509602.011785:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796862464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509602.011838:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509602.011990:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796862464 00000100:00100000:3.0:1788509602.011996:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796862464 00000100:00100000:3.0:1788509602.012040:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509602.012048:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796862464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509602.012179:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788509602.012253:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796862464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 205us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509602.012260:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788509602.012331:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796862464:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788509602.027388:0:17150:0:(import.c:65:import_set_state_nolock()) ffff8bcc87c85800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509602.027485:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875387796861952:12345-0@lo:38:kworker.0 Request processed in 18665us (18931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509602.027502:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788509602.027585:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788509602.027595:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788509602.027600:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788509602.027603:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdbbf08000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788509602.027625:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000049f162b3): req@ffff8bcc87781f80 x1875387796855040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509602.027651:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796861952:0@lo:38:kworker.0 00000100:00100000:2.0:1788509602.027802:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509602.027833:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82b00180 going to sleep for 11 seconds 00000100:00100000:0.0:1788509602.027947:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509602.027959:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796862592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509602.027986:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509602.028013:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796855040 00000100:00100000:0.0:1788509602.028018:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796855040 00000100:00100000:0.0:1788509602.028048:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796862592 00000100:00100000:0.0:1788509602.028050:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796862592 00000100:00100000:2.0:1788509602.028159:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788509602.028169:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17185:x1875387796855040:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788509602.028235:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17185:x1875387796855040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509602.028242:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788509602.028272:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875387796855040:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788509602.028301:0:17185:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788509602.028332:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875387796862720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788509602.028361:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509602.028393:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdbd3983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509602.028656:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796862720 00000100:00100000:0.0:1788509602.028661:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796862720 00000100:00100000:0.0:1788509602.028686:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788509602.028692:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796862592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788509602.028716:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788509602.028770:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1875387796862592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509602.028776:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788509602.028788:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788509602.028794:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1875387796862720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788509602.028885:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1875387796862720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509602.028891:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788509602.028942:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796862592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509602.029173:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875387796862720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788509602.029241:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875387796862848:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788509602.029269:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509602.029292:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788509602.029968:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796862848 00000100:00100000:0.0:1788509602.029976:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796862848 00000100:00100000:0.0:1788509602.030016:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788509602.030025:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1875387796862848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788509602.030372:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1875387796862848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 347us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509602.030379:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509602.032536:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875387796862848:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788509602.032610:0:17185:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788509602.034778:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788509602.034842:0:17185:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1788509602.034847:0:17185:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788509602.390628:0:18197:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509602.390825:0:18197:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788509602.709999:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788509603.298240:0:18247:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788509603.298430:0:18247:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788509603.734645:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788509604.318268:0:18295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd97292590 20000000:00000080:3.0:1788509604.318285:0:18295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bcda5bf9400 uarg=0000000000000000 20000000:01000000:3.0:1788509604.318325:0:18295:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788509604.318332:0:18295:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788509604.318337:0:18295:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788509604.318724:0:18296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788509604.318857:0:18295:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788509604.330820:0:18295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788509604.330862:0:18295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.330880:0:18295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dea2d expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.330888:0:18295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb30 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.330894:0:18295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.331095:0:18295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310deb30 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.331112:0:18295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310deb30 expref: 17 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509604.331127:0:18295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18295:1875387796862976:0@lo:104: 00000100:00100000:2.0:1788509604.331190:0:18295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509604.331236:0:18295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dea2d expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.331245:0:18295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dea2d expref: 17 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509604.331253:0:18295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18295:1875387796863104:0@lo:104: 00000100:00100000:2.0:1788509604.331273:0:18295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509604.331297:0:18295:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788509604.331432:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796862976 00000100:00100000:1.0:1788509604.331440:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796862976 00000100:00100000:1.0:1788509604.331474:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796863104 00000100:00100000:1.0:1788509604.331476:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796863104 00000100:00100000:1.0:1788509604.331491:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509604.331499:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:18295:x1875387796862976:12345-0@lo:104: 00010000:00010000:1.0:1788509604.331512:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331570:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788509604.331576:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:18295:x1875387796862976:12345-0@lo:104: Request processed in 78us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509604.331582:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509604.331601:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509604.331607:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:18295:x1875387796863104:12345-0@lo:104: 00010000:00010000:1.0:1788509604.331615:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331656:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788509604.331661:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:18295:x1875387796863104:12345-0@lo:104: Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509604.331667:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788509604.331683:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509604.331688:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331696:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509604.331699:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331717:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509604.331725:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509604.331730:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509604.331757:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331763:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509604.331781:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331787:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2600/0xe5156b86310deb30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb37 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331808:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509604.331811:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331817:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ee00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:1.0:1788509604.331819:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331826:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788509604.331832:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509604.331837:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788509604.331851:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331856:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788509604.331869:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331876:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc8846ee00/0xe5156b86310dea2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dea34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.331889:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509604.331891:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509604.331892:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509604.331928:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509604.331946:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:830aae98-6419-4d90-97fb-7d4af2af47a0:3644:1875387796863232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509604.331974:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509604.332003:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509604.332009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796863360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509604.332028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509604.332049:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796863232 00000100:00100000:1.0:1788509604.332068:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796863232 00010000:00010000:1.0:1788509604.332086:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb30 expref: 18 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509604.332105:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796863360 00000100:00100000:1.0:1788509604.332108:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796863360 00010000:00010000:1.0:1788509604.332118:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dea2d expref: 19 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509604.332130:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509604.332135:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+19:3644:x1875387796863232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509604.332145:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509604.332150:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb30 expref: 19 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332161:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310deb30 expref: 19 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332176:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509604.332201:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+19:3644:x1875387796863232:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509604.332207:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509604.332218:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509604.332223:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:3647:x1875387796863360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509604.332236:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788509604.332240:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dea2d expref: 18 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332248:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dea2d expref: 18 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332260:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332267:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332278:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332284:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332290:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332295:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332301:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509604.332305:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332312:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332330:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.332338:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509604.332366:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:3647:x1875387796863360:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509604.332373:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509604.332406:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796863360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788509604.332429:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:830aae98-6419-4d90-97fb-7d4af2af47a0:3644:1875387796863232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509604.332649:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509604.332739:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc87ce2c00/0xe5156b86310deb37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310deb30 expref: 17 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509604.332761:0:18295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18295:1875387796862976:0@lo:104: 00010000:00010000:2.0:1788509604.332774:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc862af800/0xe5156b86310dea34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dea2d expref: 16 pid: 17137 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509604.332781:0:18295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18295:1875387796863104:0@lo:104: 00010000:00010000:2.0:1788509604.332795:0:18295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.332803:0:18295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.332810:0:18295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509604.332817:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc87ce2000/0xe5156b86310deb8b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509604.758329:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509605.144013:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788509605.782262:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509606.104604:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509596/real 1788509596] req@ffff8bcc87782300 x1875387796858112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509606.104659:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87782300 x1875387796858112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509606.104671:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509596/real 1788509596] req@ffff8bcc87780000 x1875387796857984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509606.104683:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87780000 x1875387796857984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788509606.104710:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509606.104728:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788509606.104732:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796858112:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788509606.104738:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd91375800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509606.104741:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788509606.104744:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796857984:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788509606.104982:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796863488:0@lo:400:kworker.0 00000100:00080000:1.0:1788509606.104995:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509606.105001:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509606.105004:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509606.105007:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509606.105038:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509606.105042:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788509606.105045:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcd91375800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788509606.105046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788509606.105054:0:485:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:1.0:1788509606.105061:0:485:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788509606.105068:0:485:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8bcd91375800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509606.105090:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87356680 x1875387796864000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509606.105090:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509606.105099:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796863872:0@lo:400:kworker.0 00000100:00080000:1.0:1788509606.105127:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788509606.105134:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788509606.105135:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788509606.105139:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509606.105143:0:485:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:1.0:1788509606.105147:0:485:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788509606.105151:0:485:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8bcdb47be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509606.105168:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87357800 x1875387796864128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509606.105170:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796863872 00000100:00100000:0.0:1788509606.105179:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796863872 00000100:00100000:1.0:1788509606.105216:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796863616:0@lo:400:kworker.0 00000100:00100000:0.0:1788509606.105228:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788509606.105239:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796863872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509606.105253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509606.105279:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509606.105288:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796863744:0@lo:400:kworker.0 00000100:00100000:0.0:1788509606.105296:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796863872:12345-0@lo:400:kworker.0 Request processed in 58us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509606.105315:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788509606.105320:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509606.105335:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796863616 00000100:00100000:0.0:1788509606.105340:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796863616 00000100:00100000:1.0:1788509606.105358:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796863488 00000100:00100000:0.0:1788509606.105363:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788509606.105365:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796863488 00000100:00100000:0.0:1788509606.105372:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796863616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509606.105405:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788509606.105416:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796863616:12345-0@lo:400:kworker.0 Request processed in 43us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509606.105417:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+16:3647:x1875387796863488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509606.105442:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788509606.105461:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+16:3647:x1875387796863488:12345-0@lo:400:kworker.0 Request processed in 47us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509606.105482:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788509606.105488:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796864256:0@lo:400:kworker.0 00000100:00100000:0.0:1788509606.105518:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509606.105603:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796863872:0@lo:400:kworker.0 00000100:00100000:0.0:1788509606.105611:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796863488:0@lo:400:kworker.0 00000100:00100000:1.0:1788509606.105664:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796863744 00000100:00100000:1.0:1788509606.105670:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796863744 00000100:00100000:1.0:1788509606.105714:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796864256 00000100:00100000:1.0:1788509606.105717:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796864256 00000100:00100000:1.0:1788509606.105737:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509606.105743:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796863744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509606.105784:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796863744:12345-0@lo:400:kworker.0 Request processed in 41us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509606.105791:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509606.105803:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788509606.105809:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796864256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509606.105838:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796864256:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509606.105844:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788509606.105870:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcc87354000 x1875387796863744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509606.105880:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796863744:0@lo:400:kworker.0 00000100:00100000:1.0:1788509606.105889:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796863616:0@lo:400:kworker.0 00010000:00080000:1.0:1788509606.105938:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcc87357480 x1875387796864256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509606.105947:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796864256:0@lo:400:kworker.0 00000100:00100000:1.0:1788509606.105973:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796864000:0@lo:8:kworker.0 00000400:00000100:1.0:1788509606.105992:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796864000 offset 0 length 520: 4 00000100:00100000:1.0:1788509606.106005:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796864128:0@lo:8:kworker.0 00000400:00000100:1.0:1788509606.106018:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796864128 offset 0 length 520: 4 10000000:01000000:2.0:1788509606.297683:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788509606.297699:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd83147800 from 13 10000000:01000000:2.0:1788509606.297705:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788509606.297757:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509606.297769:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509606.297779:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509606.297803:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788509606.303365:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509606.303409:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a4a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509606.303576:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796864384 00000100:00100000:2.0:1788509606.303586:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796864384 00000100:00100000:2.0:1788509606.303654:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788509606.303665:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+16:17142:x1875387796864384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509606.303683:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509606.303716:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310deb92 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509606.303744:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310deb92 expref: 17 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509606.303756:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb92 expref: 17 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509606.303765:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2600, rc 0) 00000100:00100000:2.0:1788509606.303814:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796864384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509606.303822:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788509606.304455:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509606.304484:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509606.304511:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509606.304594:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509606.304646:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509606.304681:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb054a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788509606.304857:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796864512 00000100:00100000:1.0:1788509606.304862:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796864512 00000100:00100000:1.0:1788509606.304927:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788509606.304936:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796864512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509606.305215:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796864512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509606.305223:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788509606.307196:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509606.307253:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509606.307321:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509606.307355:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb054a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788509606.307374:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796864640 00000100:00100000:3.0:1788509606.307380:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796864640 00000100:00100000:3.0:1788509606.307428:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788509606.307437:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796864640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509606.307853:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796864640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 415us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509606.307861:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788509606.307940:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788509606.309459:0:18365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788509606.310976:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788509606.311000:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509606.311012:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509606.311025:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509606.311037:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509606.311039:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcc870ca000 from 13 10000000:01000000:0.0:1788509606.311043:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509606.311078:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509606.311086:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509606.311105:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509606.311132:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509606.311196:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509606.311233:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271540 going to sleep for 11 seconds 00000100:00100000:2.0:1788509606.311306:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796864768 00000100:00100000:2.0:1788509606.311314:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796864768 00000100:00100000:2.0:1788509606.311350:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788509606.311358:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+17:17142:x1875387796864768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509606.311369:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509606.311379:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310deba0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509606.311402:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310deba0 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509606.311429:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deba0 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509606.311437:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce3c00, rc 0) 00000100:00100000:2.0:1788509606.311474:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17142:x1875387796864768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509606.311480:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788509606.311573:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509606.311587:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509606.311595:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509606.311660:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509606.311684:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509606.311714:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271540 going to sleep for 11 seconds 00000100:00100000:2.0:1788509606.311809:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796864896 00000100:00100000:2.0:1788509606.311813:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796864896 00000100:00100000:2.0:1788509606.311843:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788509606.311850:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17142:x1875387796864896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509606.311979:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17142:x1875387796864896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509606.311986:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788509606.312059:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796864896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509606.312086:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796865024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509606.312127:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509606.312186:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271540 going to sleep for 11 seconds 00000100:00100000:2.0:1788509606.314745:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796865024 00000100:00100000:2.0:1788509606.314761:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796865024 00000100:00100000:2.0:1788509606.314871:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788509606.314881:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17142:x1875387796865024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788509606.315865:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+18:17142:x1875387796865024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 982us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509606.315874:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788509606.315995:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796865024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788509606.316757:0:18366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788509606.316818:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788509606.316838:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788509606.316849:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509606.316859:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509606.809275:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509607.130832:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509607.130854:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796865152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509607.130945:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509607.130989:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796865152 00000100:00100000:2.0:1788509607.130997:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796865152 00000100:00100000:2.0:1788509607.131277:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509607.131287:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796865152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509607.131321:0:17886:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788509607.131369:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796865152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509607.131377:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509607.131424:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796865152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509607.136800:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509607.151014:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796865280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509607.151088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509607.154160:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796865280 00000100:00100000:3.0:1788509607.154175:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796865280 00000100:00100000:3.0:1788509607.154238:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788509607.154249:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796865280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509607.154287:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788509607.154386:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796865280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509607.154394:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788509607.162088:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796865280:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788509607.657706:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788509607.830003:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509608.155749:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509593/real 1788509593] req@ffff8bcdb787ca80 x1875387796856064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509608 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509608.155781:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcdb787ca80 x1875387796856064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509608 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509608.155793:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509593/real 1788509593] req@ffff8bcdb787ed80 x1875387796856192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509608 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509608.155805:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcdb787ed80 x1875387796856192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509608 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788509608.155824:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd9f604000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788509608.155846:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788509608.155850:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796856064:0@lo:8:kworker.0 00000100:00080000:2.0:1788509608.155856:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788509608.155861:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788509608.155864:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796856192:0@lo:8:kworker.0 00000100:00080000:1.0:1788509608.156995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509608.157000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788509608.157004:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bcd9f604000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509608.157011:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:1.0:1788509608.157017:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788509608.157023:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bcd9f604000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509608.157041:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87354000 x1875387796865664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509608.157057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509608.157061:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788509608.157072:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788509608.157076:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:1.0:1788509608.157079:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788509608.157082:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bcc810b5000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509608.157094:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87355880 x1875387796865792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509608.157125:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509608.157129:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509608.157132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509608.157136:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788509608.157163:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796865536:0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.157235:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509608.157278:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788509608.157284:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796865408:0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.157310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509608.157331:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796866176:0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.157354:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509608.157377:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796865920:0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.157399:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509608.157414:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509608.157419:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796866048:0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.157438:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509608.157478:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796865536 00000100:00100000:1.0:1788509608.157484:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796865536 00000100:00100000:1.0:1788509608.157526:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796866048 00000100:00100000:1.0:1788509608.157529:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796866048 00000100:00100000:1.0:1788509608.157543:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788509608.157550:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796865536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.157600:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796865536:12345-0@lo:400:kworker.0 Request processed in 50us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509608.157608:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788509608.157623:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788509608.157629:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796866048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.157657:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796866048:12345-0@lo:400:kworker.0 Request processed in 28us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509608.157663:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788509608.157832:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796865408 00000100:00100000:1.0:1788509608.157837:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796865408 00000100:00100000:1.0:1788509608.157866:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788509608.157872:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:3647:x1875387796865408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.157926:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:3647:x1875387796865408:12345-0@lo:400:kworker.0 Request processed in 55us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509608.157933:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788509608.157960:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796866176 00000100:00100000:1.0:1788509608.157964:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796866176 00000100:00100000:1.0:1788509608.157988:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796865920 00000100:00100000:1.0:1788509608.157990:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796865920 00000100:00100000:1.0:1788509608.158002:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788509608.158008:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796866176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.158035:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796866176:12345-0@lo:400:kworker.0 Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509608.158050:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788509608.158061:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788509608.158067:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796865920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.158094:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796865920:12345-0@lo:400:kworker.0 Request processed in 28us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509608.158101:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788509608.158141:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796865408:0@lo:400:kworker.0 00010000:00080000:1.0:1788509608.158154:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcc87356a00 x1875387796866176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509608.158165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796866176:0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.158243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796865536:0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.158280:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796866048:0@lo:400:kworker.0 00010000:00080000:1.0:1788509608.158290:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcc87355c00 x1875387796865920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509608.158299:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796865920:0@lo:400:kworker.0 00000100:00100000:1.0:1788509608.158325:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796865664:0@lo:8:kworker.0 00000400:00000100:1.0:1788509608.158346:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796865664 offset 0 length 520: 4 00000100:00100000:1.0:1788509608.158361:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796865792:0@lo:8:kworker.0 00000400:00000100:1.0:1788509608.158380:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875387796865792 offset 0 length 520: 4 00010000:00010000:1.0:1788509608.859722:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788509608.983502:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788509609.878384:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509610.904055:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788509611.625384:0:18644:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788509611.625392:0:18644:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788509611.625394:0:18644:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788509611.625493:0:18644:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bcd89112800 00000020:01000004:0.0:1788509611.625509:0:18644:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788509611.625522:0:18644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788509611.625537:0:18644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8bcd9e5dcd40) 00000020:00000080:0.0:1788509611.625554:0:18644:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788509611.721883:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788509611.728624:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788509611.729774:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788509611.730346:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788509611.730777:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788509611.731133:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788509611.731796:0:18644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788509611.733680:0:18644:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788509611.733890:0:18644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788509611.733950:0:18644:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788509611.734006:0:18644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe5156b86310debb5 00000020:01000004:3.0:1788509611.734014:0:18644:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788509611.734035:0:18644:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788509611.734039:0:18644:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788509611.734045:0:18644:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788509611.734049:0:18644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788509611.734060:0:18644:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8bcd97e719c0) 00000020:00000080:3.0:1788509611.734070:0:18644:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788509611.736181:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788509611.736360:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788509611.736366:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788509611.745961:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788509611.745988:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788509611.746847:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788509611.746855:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788509611.757614:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788509611.758219:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788509611.758299:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788509611.763634:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788509611.763671:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788509611.807825:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788509611.808231:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788509611.808237:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788509611.810938:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788509611.810950:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788509611.812562:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788509611.812574:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788509611.818582:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788509611.818975:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788509611.819094:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788509611.821553:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788509611.821568:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788509611.884664:0:18644:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788509611.884871:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788509611.884877:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788509611.886746:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788509611.886759:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788509611.887600:0:18644:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788509611.887634:0:18644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788509611.887646:0:18644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788509611.914648:0:18644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788509611.914697:0:18644:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788509611.914701:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788509611.914702:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788509611.914704:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509611.914705:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509611.914706:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509611.914707:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509611.914708:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788509611.914710:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509611.914711:0:18644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788509611.914715:0:18644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788509611.914717:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788509611.914718:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788509611.914719:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509611.914720:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509611.914721:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509611.914722:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509611.914723:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788509611.914724:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509611.914725:0:18644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788509611.914751:0:18644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788509611.914770:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788509611.914851:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509611.914987:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd891b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788509611.915542:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796866304 00000100:00100000:0.0:1788509611.915550:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796866304 00000100:00100000:0.0:1788509611.915651:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788509611.915671:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+18:18644:x1875387796866304:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788509611.915711:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788509611.915714:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788509611.915718:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788509611.916050:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+18:18644:x1875387796866304:12345-0@lo:253:mount.lustre.0 Request processed in 380us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509611.916058:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788509611.916136:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866304:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788509611.916147:0:18644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788509611.916150:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788509611.916151:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788509611.916152:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509611.916167:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509611.916168:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509611.916170:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509611.916171:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788509611.916173:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509611.916175:0:18644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788509611.916194:0:18644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bcd89112800 from lustre-OST0000 10000000:01000000:3.0:1788509611.916233:0:18644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788509611.916236:0:18644:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788509611.916243:0:18644:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bcdb4623380 local copy 00010000:00010000:3.0:1788509611.916252:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509611.916343:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509611.916397:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509611.918071:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda0022840 going to sleep for 11 seconds 00000100:00100000:1.0:1788509611.918297:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796866432 00000100:00100000:1.0:1788509611.918305:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796866432 00000100:00100000:1.0:1788509611.918351:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788509611.918512:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:18644:x1875387796866432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788509611.918667:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:18644:x1875387796866432:12345-0@lo:501:mount.lustre.0 Request processed in 299us (2269us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788509611.918674:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788509611.918857:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866432:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788509611.918883:0:18644:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788509611.919687:0:18644:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788509611.919697:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.919710:0:18644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509611.919848:0:18644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bcd89112800 10000000:01000000:3.0:1788509611.919855:0:18644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788509611.919861:0:18644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788509611.919865:0:18644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788509611.919870:0:18644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788509611.919873:0:18644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788509611.919971:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310debc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.920103:0:18644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310debc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.920114:0:18644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310debc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509611.920136:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788509611.920302:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509611.920582:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda0022840 going to sleep for 11 seconds 00000100:00100000:1.0:1788509611.920637:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796866560 00000100:00100000:1.0:1788509611.920644:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796866560 00000100:00100000:1.0:1788509611.920700:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788509611.920708:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+18:18644:x1875387796866560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509611.920720:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509611.920732:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862aee00/0xe5156b86310debca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310debc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509611.920879:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862aee00/0xe5156b86310debca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310debc3 expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509611.920893:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862aee00/0xe5156b86310debca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310debc3 expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509611.921155:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862aee00, rc 0) 00000100:00100000:1.0:1788509611.921206:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796866560:12345-0@lo:101:mount.lustre.0 Request processed in 498us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509611.921213:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788509611.921300:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509611.921316:0:18644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310debc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debca expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.921327:0:18644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310debc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310debca expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788509611.922661:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788509611.923318:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509611.926299:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00010000:00010000:2.0:1788509611.926625:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788509611.926669:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788509611.926690:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788509611.926705:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788509611.926719:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788509611.926752:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788509611.926867:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788509611.926874:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788509611.931226:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509611.931293:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509611.931398:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda0022b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509611.931697:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796866688 00000100:00100000:2.0:1788509611.931704:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796866688 00000100:00100000:2.0:1788509611.931872:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788509611.931883:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796866688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509611.934432:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796866688:12345-0@lo:501:mount.lustre.0 Request processed in 2548us (3135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509611.934442:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788509611.934934:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788509611.935017:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788509611.935065:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509611.937782:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788509611.942667:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796866816 00000100:00100000:0.0:1788509611.942681:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796866816 00000100:00100000:1.0:1788509611.942817:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788509611.942827:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796866816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788509611.944112:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796866816:12345-0@lo:503:mount.lustre.0 Request processed in 1283us (9043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509611.944124:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788509611.944689:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788509611.945352:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788509611.945697:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788509611.945825:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509611.945854:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb054eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509611.945933:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796866944 00000100:00100000:2.0:1788509611.945941:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796866944 00000100:00100000:2.0:1788509611.945999:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788509611.946007:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796866944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509611.946751:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796866944:12345-0@lo:502:mount.lustre.0 Request processed in 741us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509611.946773:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788509611.946967:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796866944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788509611.950528:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788509611.950585:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788509611.950600:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788509611.950615:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788509611.950627:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788509611.950641:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788509611.950663:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788509611.950678:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788509611.950692:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788509611.950705:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788509611.950719:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788509611.950732:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788509611.953704:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788509611.953806:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509611.953842:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8c7f8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788509611.953997:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796867072 00000100:00100000:2.0:1788509611.954005:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796867072 00000100:00100000:2.0:1788509611.954056:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788509611.954064:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796867072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509611.954190:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796867072:12345-0@lo:502:mount.lustre.0 Request processed in 127us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509611.954198:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788509611.954724:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788509611.954812:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788509611.954825:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788509611.955874:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788509611.955883:0:18661:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788509611.955890:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.955893:0:18661:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788509611.955927:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788509611.955943:0:18661:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8bcdb0e24d40) 00000020:00000080:2.0:1788509611.955967:0:18661:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788509611.955972:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788509611.956077:0:18661:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcd89112800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788509611.956086:0:18661:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788509611.956094:0:18661:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe5156b86310debd8 00010000:00010000:2.0:1788509611.967752:0:18661:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788509611.968337:0:18661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788509611.970799:0:18661:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788509611.973051:0:18661:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788509611.973065:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509611.973071:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.973073:0:18661:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788509611.973076:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788509611.973080:0:18661:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788509611.973082:0:18661:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788509611.973084:0:18661:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788509611.973086:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788509611.973088:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.973090:0:18661:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788509611.973092:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509611.973095:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.973096:0:18661:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788509611.973099:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788509611.973101:0:18661:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788509611.973103:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509611.973106:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.973107:0:18661:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788509611.973110:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509611.973112:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.973114:0:18661:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788509611.973117:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788509611.973145:0:18661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509611.973148:0:18661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.973149:0:18661:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788509611.973153:0:18661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788509611.973620:0:18644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788509611.973670:0:18644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788509611.973692:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310debc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debca expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509611.973720:0:18644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9600/0xe5156b86310debc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debca expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509611.973729:0:18644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd89112800 from 1 10000000:01000000:0.0:1788509611.973732:0:18644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509611.973767:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509611.973775:0:18644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509611.973785:0:18644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509611.973809:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788509611.973874:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509611.973937:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb054eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509611.974007:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796867200 00000100:00100000:3.0:1788509611.974015:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796867200 00000100:00100000:3.0:1788509611.974063:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788509611.974073:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+19:18644:x1875387796867200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509611.974086:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509611.974098:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310debdf expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.974122:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310debdf expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.974132:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310debdf expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.974140:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d8a00, rc 0) 00000100:00100000:3.0:1788509611.974431:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867200:12345-0@lo:101:mount.lustre.0 Request processed in 358us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509611.974438:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788509611.975586:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788509611.975609:0:18644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509611.975621:0:18644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788509611.980044:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788509611.980509:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509611.980722:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788509611.980748:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788509611.980778:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788509611.980784:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788509611.980861:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509611.980963:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509611.981171:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796867328 00000100:00100000:3.0:1788509611.981179:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796867328 00000100:00100000:3.0:1788509611.981233:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788509611.981242:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509611.983792:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8c7f8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788509611.987242:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867328:12345-0@lo:501:mount.lustre.0 Request processed in 5992us (6271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509611.987258:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788509611.987879:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509611.987967:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509611.988136:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509611.988288:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8c7f8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788509611.988433:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796867456 00000100:00100000:3.0:1788509611.988441:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796867456 00000100:00100000:3.0:1788509611.988489:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788509611.988498:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788509611.988614:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867456:12345-0@lo:503:mount.lustre.0 Request processed in 116us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509611.988621:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788509611.988788:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788509611.989793:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788509611.989876:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509611.991118:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509611.991249:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796867584 00000100:00100000:3.0:1788509611.991256:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796867584 00000100:00100000:3.0:1788509611.991339:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788509611.991349:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509611.991477:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867584:12345-0@lo:502:mount.lustre.0 Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509611.991485:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788509611.991537:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd982480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509611.991557:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788509611.991752:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788509611.991776:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788509611.991788:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788509611.991799:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788509611.991809:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788509611.991819:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788509611.991829:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788509611.991839:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788509611.991849:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788509611.991860:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788509611.991870:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788509611.991895:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509611.991959:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509611.992727:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd982480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509611.992760:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796867712 00000100:00100000:0.0:1788509611.992767:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796867712 00000100:00100000:1.0:1788509611.992812:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788509611.992821:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788509611.992943:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867712:12345-0@lo:502:mount.lustre.0 Request processed in 122us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509611.992950:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788509611.993135:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788509611.993199:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788509611.993209:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788509611.994165:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509611.994177:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.994180:0:18665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788509611.994186:0:18665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcd89112800 00000020:00000080:2.0:1788509611.994189:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788509611.994196:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509611.994198:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.994199:0:18665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788509611.994202:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509611.994210:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.994211:0:18665:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788509611.994214:0:18665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcd89112800 00000020:00000080:2.0:1788509611.994216:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788509611.994265:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509611.994269:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.994271:0:18665:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788509611.994273:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509611.994275:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.994277:0:18665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788509611.994279:0:18665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcd89112800 00000020:00000080:2.0:1788509611.994281:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788509611.994298:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509611.994301:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.994302:0:18665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788509611.994305:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788509611.994307:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.994308:0:18665:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788509611.994312:0:18665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcd89112800 00000020:00000080:2.0:1788509611.994314:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788509611.994336:0:18665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788509611.994339:0:18665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509611.994340:0:18665:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788509611.994343:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788509611.994550:0:18644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788509611.994575:0:18644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788509611.994596:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.994608:0:18644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509611.994678:0:18644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788509611.994681:0:18644:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bcd89112800 10000000:01000000:3.0:1788509611.994684:0:18644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bcd89112800 10000000:01000000:3.0:1788509611.994688:0:18644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788509611.994694:0:18644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcd89112800 from 1 10000000:01000000:3.0:1788509611.994696:0:18644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509611.994728:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9800/0xe5156b86310debed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.994737:0:18644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9800/0xe5156b86310debed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.994746:0:18644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9800/0xe5156b86310debed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509611.994767:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788509611.994824:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509611.994855:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda0022c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509611.997201:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796867840 00000100:00100000:2.0:1788509611.997216:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796867840 00000100:00100000:2.0:1788509611.997278:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788509611.997289:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+20:18644:x1875387796867840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509611.997305:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509611.997322:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce2800/0xe5156b86310debf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310debed expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509611.997437:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce2800/0xe5156b86310debf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310debed expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509611.997450:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce2800/0xe5156b86310debf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310debed expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509611.997457:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2800, rc 0) 00000100:00100000:2.0:1788509611.997524:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796867840:12345-0@lo:101:mount.lustre.0 Request processed in 238us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509611.997531:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788509611.997772:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509611.997790:0:18644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9800/0xe5156b86310debed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debf4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509611.997800:0:18644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9800/0xe5156b86310debed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310debf4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788509612.001159:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788509612.001548:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509612.001746:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788509612.001771:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788509612.001786:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788509612.001799:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788509612.001814:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788509612.001827:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788509612.001841:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788509612.001854:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788509612.001867:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788509612.001879:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788509612.001891:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788509612.001941:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788509612.001956:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788509612.001970:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788509612.002152:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788509612.002169:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788509612.002182:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788509612.002204:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788509612.002218:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788509612.002230:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788509612.002242:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788509612.002255:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788509612.002267:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788509612.002281:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788509612.002293:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788509612.002306:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788509612.002319:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788509612.002331:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788509612.002344:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788509612.002431:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788509612.002463:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788509612.002477:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788509612.002489:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788509612.002502:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788509612.002513:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788509612.002523:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788509612.002535:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788509612.002553:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788509612.002558:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788509612.002647:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509612.002722:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509612.002759:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82edae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509612.012541:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796867968 00000100:00100000:3.0:1788509612.012556:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796867968 00000100:00100000:3.0:1788509612.012610:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788509612.012627:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796867968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509612.012813:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796867968:12345-0@lo:501:mount.lustre.0 Request processed in 188us (10091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509612.012821:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788509612.013482:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796867968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509612.013533:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796868096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509612.013584:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509612.013610:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82edae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509612.015182:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796868096 00000100:00100000:3.0:1788509612.015193:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796868096 00000100:00100000:3.0:1788509612.015248:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788509612.015259:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796868096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788509612.015413:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796868096:12345-0@lo:503:mount.lustre.0 Request processed in 155us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509612.015421:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788509612.016212:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796868096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788509612.018789:0:18644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788509612.018894:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796868224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509612.019452:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509612.019502:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd982480c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509612.019985:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796868224 00000100:00100000:3.0:1788509612.020059:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796868224 00000100:00100000:3.0:1788509612.020114:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788509612.020123:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796868224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509612.020364:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796868224:12345-0@lo:502:mount.lustre.0 Request processed in 232us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509612.020373:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788509612.031825:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796868224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788509612.037638:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788509612.037691:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788509612.037707:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788509612.037721:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788509612.037734:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788509612.037747:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788509612.039444:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788509612.039489:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788509612.039505:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788509612.039522:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788509612.039540:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788509612.039558:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788509612.039574:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788509612.039599:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788509612.039611:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788509612.039624:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788509612.039667:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788509612.039687:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788509612.039707:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788509612.039725:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788509612.039743:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788509612.039842:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788509612.040115:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788509612.040140:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788509612.040160:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788509612.040174:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788509612.040190:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788509612.040205:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788509612.040220:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788509612.040231:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788509612.040241:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788509612.040252:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788509612.040277:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788509612.040289:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788509612.040299:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788509612.040310:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788509612.040320:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788509612.040330:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788509612.040340:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788509612.040351:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788509612.040481:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788509612.040496:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788509612.040511:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788509612.040530:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788509612.040550:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788509612.040572:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788509612.040606:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788509612.040625:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788509612.040712:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796868352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509612.041561:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509612.041636:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82edae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788509612.041684:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796868352 00000100:00100000:3.0:1788509612.041692:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796868352 00000100:00100000:3.0:1788509612.041841:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788509612.041852:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796868352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509612.042244:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796868352:12345-0@lo:502:mount.lustre.0 Request processed in 394us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509612.042252:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788509612.046551:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796868352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788509612.046843:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788509612.047548:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788509612.047610:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796868480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788509612.047694:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509612.047736:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a25e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788509612.047963:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796868480 00000100:00100000:3.0:1788509612.048216:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796868480 00000100:00100000:3.0:1788509612.048282:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788509612.048293:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796868480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509612.048497:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796868480:12345-0@lo:502:mount.lustre.0 Request processed in 206us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509612.048505:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788509612.049119:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796868480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788509612.049451:0:18644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788509612.049462:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788509612.051305:0:18671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788509612.051323:0:18671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8bcc863019c0) 00000020:00000080:1.0:1788509612.051608:0:18671:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788509612.051728:0:18671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcd89112800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788509612.051732:0:18671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcd89112800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788509612.051735:0:18671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd89112800 3 00010000:00080000:1.0:1788509612.051761:0:18671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc86525800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788509612.057844:0:18671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788509612.059106:0:18671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788509612.059151:0:18671:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788509612.059163:0:18671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe5156b86310dec02 00000100:00080000:1.0:1788509612.059173:0:18671:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788509612.059180:0:18671:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8bcc86525800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788509612.059225:0:18671:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcdb5c5f800 x1875387796868608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788509612.059257:0:18671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788509612.059311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509612.059316:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509612.059319:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509612.059322:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509612.059345:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509612.059348:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509612.059351:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509612.059364:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788509612.059399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796868736:0@lo:400:kworker.0 00000100:00100000:1.0:1788509612.059472:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509612.059512:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509612.059518:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796869120:0@lo:400:kworker.0 00000100:00100000:1.0:1788509612.059544:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509612.059572:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796868864:0@lo:400:kworker.0 00000100:00100000:1.0:1788509612.059593:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509612.059608:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509612.059613:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796868992:0@lo:400:kworker.0 00000100:00100000:1.0:1788509612.059631:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509612.062043:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796868608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788509612.062107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509612.062169:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796869120 00000100:00100000:0.0:1788509612.062176:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796869120 00000100:00100000:0.0:1788509612.062212:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796868864 00000100:00100000:0.0:1788509612.062214:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796868864 00000100:00100000:0.0:1788509612.062226:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796868608 00000100:00100000:0.0:1788509612.062229:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796868608 00000100:00100000:0.0:1788509612.062242:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509612.062249:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796869120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509612.062319:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796869120:12345-0@lo:400:kworker.0 Request processed in 69us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.062327:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509612.062344:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509612.062362:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796868864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509612.062398:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796868864:12345-0@lo:400:kworker.0 Request processed in 48us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.062403:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509612.062414:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788509612.062417:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875387796868608:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788509612.062439:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1788509612.062473:0:17144:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe5156b86310dec09 00000004:00100000:0.0:1788509612.062486:0:17144:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788509612.062515:0:17144:0:(import.c:65:import_set_state_nolock()) ffff8bcc87322800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509612.062549:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875387796868608:12345-0@lo:38:llog_process_th.0 Request processed in 130us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.062564:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788509612.062619:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcdb5c5f100 x1875387796868864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509612.062636:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796868864:0@lo:400:kworker.0 00010000:00080000:0.0:1788509612.062676:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcdb5c5f800 x1875387796868608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509612.062685:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509612.062691:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788509612.062698:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788509612.062702:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788509612.062705:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc86525800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788509612.062710:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875387796868608:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788509612.062735:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcdb5c5fb80 x1875387796869120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509612.062749:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796869120:0@lo:400:kworker.0 00000100:00100000:0.0:1788509612.063162:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796868736 00000100:00100000:0.0:1788509612.063168:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796868736 00000100:00100000:0.0:1788509612.063200:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796868992 00000100:00100000:0.0:1788509612.063202:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796868992 00000100:00100000:0.0:1788509612.063217:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788509612.063223:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796868736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509612.063264:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796868736:12345-0@lo:400:kworker.0 Request processed in 41us (3793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.063270:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788509612.063294:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788509612.063299:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796868992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509612.063332:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796868992:12345-0@lo:400:kworker.0 Request processed in 32us (3699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.063338:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788509612.063380:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796868992:0@lo:400:kworker.0 00000100:00100000:0.0:1788509612.063405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796868736:0@lo:400:kworker.0 00000020:01000004:3.0:1788509612.065557:0:18671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788509612.065574:0:18671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8bcd97e74d40) 00000020:00000080:3.0:1788509612.065599:0:18671:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788509612.065705:0:18671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcd89112800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788509612.065709:0:18671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcd89112800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788509612.065712:0:18671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcd89112800 3 00010000:00080000:3.0:1788509612.065743:0:18671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc870b4000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788509612.070847:0:18671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788509612.071328:0:18671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788509612.071389:0:18671:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788509612.071401:0:18671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe5156b86310dec17 00000100:00080000:3.0:1788509612.071410:0:18671:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788509612.071417:0:18671:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8bcc870b4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788509612.071451:0:18671:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd87c6b480 x1875387796869248/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788509612.071482:0:18671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788509612.071744:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875387796869248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788509612.071830:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788509612.071895:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509612.071932:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509612.071936:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509612.071939:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509612.071944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509612.071948:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788509612.071950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788509612.071953:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788509612.072179:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796869248 00000100:00100000:3.0:1788509612.072186:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796869248 00000100:00100000:3.0:1788509612.072227:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788509612.072235:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875387796869248:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788509612.072261:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1788509612.072309:0:17144:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe5156b86310dec1e 00000004:00100000:3.0:1788509612.072328:0:17144:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788509612.072431:0:17144:0:(import.c:65:import_set_state_nolock()) ffff8bcc870b5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788509612.072491:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875387796869248:12345-0@lo:38:llog_process_th.0 Request processed in 256us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509612.072500:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788509612.072546:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bcd87c6b480 x1875387796869248/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509612.072557:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788509612.072564:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788509612.072572:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788509612.072576:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788509612.072578:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc870b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788509612.072585:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875387796869248:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788509612.072700:0:18671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788509612.072825:0:18644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788509612.072872:0:18644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788509612.072893:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9800/0xe5156b86310debed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debf4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509612.072932:0:18644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9800/0xe5156b86310debed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310debf4 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788509612.073249:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788509612.073251:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788509612.073253:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509612.073254:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509612.073255:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509612.073256:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509612.073258:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788509612.073265:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509612.073267:0:18644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788509612.073271:0:18644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788509612.073273:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788509612.073274:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788509612.073275:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788509612.073276:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788509612.073277:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788509612.073277:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788509612.073278:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788509612.073279:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788509612.073280:0:18644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788509612.073300:0:18644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788509612.073320:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796869376:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788509612.073565:0:18644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509612.075468:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdaf817780 going to sleep for 11 seconds 00000100:00100000:1.0:1788509612.077883:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796869376 00000100:00100000:1.0:1788509612.079616:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796869376 00000100:00100000:1.0:1788509612.079690:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788509612.079700:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:18644:x1875387796869376:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788509612.079732:0:17137:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788509612.079747:0:17137:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788509612.088395:0:17137:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788509612.088571:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788509612.090962:0:17160:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788509612.090971:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788509612.091010:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091029:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb68 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091037:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb76 expref: 21 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091045:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091088:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310deb76 expref: 21 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091104:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310deb76 expref: 21 pid: 17139 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509612.091131:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796869504:0@lo:104: 00000100:00100000:0.0:1788509612.091203:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509612.091288:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310deb68 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091297:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310deb68 expref: 21 pid: 17137 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509612.091305:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796869632:0@lo:104: 00000100:00100000:0.0:1788509612.091332:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509612.091589:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd982480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509612.091621:0:17127:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788509612.091640:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796869504 00000100:00100000:0.0:1788509612.091647:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796869504 00000100:00100000:0.0:1788509612.091693:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796869632 00000100:00100000:0.0:1788509612.091697:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796869632 00000100:00100000:0.0:1788509612.091712:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509612.091721:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:17160:x1875387796869504:12345-0@lo:104: 00010000:00010000:0.0:1788509612.091735:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091787:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509612.091793:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:17160:x1875387796869504:12345-0@lo:104: Request processed in 73us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.091800:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509612.091817:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509612.091823:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:17160:x1875387796869632:12345-0@lo:104: 00010000:00010000:0.0:1788509612.091830:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091864:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788509612.091877:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:17160:x1875387796869632:12345-0@lo:104: Request processed in 55us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.091884:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788509612.091942:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509612.091949:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091957:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af600 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509612.091961:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.091970:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509612.092095:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509612.092102:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509612.092145:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.092152:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509612.092240:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.092249:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc862af600/0xe5156b86310deb76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb7d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.092262:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509612.092265:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.092283:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509612.092286:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.092294:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509612.092300:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509612.092306:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509612.092319:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.092325:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509612.092339:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.092346:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc862ae000/0xe5156b86310deb68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb6f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.092542:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509612.092545:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509612.092546:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509612.092555:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509612.092750:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796869760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509612.092794:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509612.092832:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:830aae98-6419-4d90-97fb-7d4af2af47a0:3644:1875387796869888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509612.092865:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509612.092922:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796869760 00000100:00100000:0.0:1788509612.092928:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796869760 00010000:00010000:0.0:1788509612.092949:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb76 expref: 22 pid: 17139 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509612.092972:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796869888 00000100:00100000:0.0:1788509612.092975:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796869888 00000100:00100000:3.0:1788509612.093600:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+23:18644:x1875387796869376:12345-0@lo:253:mount.lustre.0 Request processed in 13900us (20033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509612.093611:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788509612.093720:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:18644:1875387796869376:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788509612.093735:0:18644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788509612.093739:0:18644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788509612.093741:0:18644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788509612.093743:0:18644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788509612.093745:0:18644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788509612.093746:0:18644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788509612.093747:0:18644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788509612.093749:0:18644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788509612.093751:0:18644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788509612.093753:0:18644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788509612.093771:0:18644:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788509612.094489:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb68 expref: 22 pid: 17137 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509612.094514:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509612.094524:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:3647:x1875387796869760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509612.094537:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509612.094542:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb76 expref: 22 pid: 17139 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094553:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310deb76 expref: 22 pid: 17139 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094571:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509612.094631:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:3647:x1875387796869760:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.094638:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509612.094662:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509612.094669:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3644:x1875387796869888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509612.094676:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509612.094681:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb68 expref: 21 pid: 17137 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094701:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310deb68 expref: 21 pid: 17137 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094713:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094722:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788509612.094736:0:17130:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004845795s 00010000:00010000:0.0:1788509612.094740:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094747:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094753:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094759:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094765:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509612.094769:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094777:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094784:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.094800:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509612.094831:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3644:x1875387796869888:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.094837:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509612.094934:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:830aae98-6419-4d90-97fb-7d4af2af47a0:3644:1875387796869888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509612.094963:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8400/0xe5156b86310deb7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310deb76 expref: 20 pid: 17139 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509612.094974:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796869504:0@lo:104: 00000100:00100000:2.0:1788509612.095700:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796869760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509612.096489:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc8846fc00/0xe5156b86310deb6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310deb68 expref: 19 pid: 17137 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509612.096502:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796869632:0@lo:104: 00010000:00010000:0.0:1788509612.096522:0:17160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.096532:0:17160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.096537:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509612.096543:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc8846e000/0xe5156b86310dec25 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788509612.099140:0:18644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788509612.107321:0:18644:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788509612.107330:0:18644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788509612.107361:0:18644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788509612.107402:0:18644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788509612.107421:0:18644:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788509612.107450:0:18644:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788509612.108280:0:18644:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509612.108461:0:18644:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788509612.246168:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509612.246190:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796870016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509612.246264:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509612.248305:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796870016 00000100:00100000:0.0:1788509612.248315:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796870016 00000100:00100000:3.0:1788509612.248337:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788509612.248356:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796870144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509612.248371:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788509612.248390:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796870016:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509612.248427:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788509612.248439:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788509612.248474:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796870144 00000100:00100000:3.0:1788509612.248480:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796870144 00000100:00100000:0.0:1788509612.248499:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796870016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509612.248508:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788509612.248517:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788509612.248528:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796870144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509612.248550:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788509612.248578:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796870016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509612.248596:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796870144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509612.248612:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788509612.248676:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796870144:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788509612.951500:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788509613.102355:0:18724:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509613.102636:0:18724:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788509613.275120:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788509613.275127:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd83147800 from 9 10000000:01000000:0.0:1788509613.275132:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788509613.275179:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509613.275191:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509613.275202:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509613.275226:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796870272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509613.275291:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509613.275327:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509613.275355:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796870272 00000100:00100000:0.0:1788509613.275361:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796870272 00000100:00100000:0.0:1788509613.275403:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788509613.275412:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+19:17142:x1875387796870272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509613.275423:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509613.275436:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dec2c expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509613.275470:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dec2c expref: 20 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509613.275480:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dec2c expref: 20 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509613.275489:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846f600, rc 0) 00000100:00100000:0.0:1788509613.275527:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+20:17142:x1875387796870272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509613.275533:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788509613.275579:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796870272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509613.275593:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509613.275602:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509613.275662:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796870400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788509613.275692:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509613.275709:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc876dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788509613.276300:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796870400 00000100:00100000:3.0:1788509613.276306:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796870400 00000100:00100000:3.0:1788509613.276343:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788509613.276351:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+20:17142:x1875387796870400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788509613.276367:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788509613.276386:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788509613.276389:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788509613.276476:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+20:17142:x1875387796870400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509613.276484:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788509613.276521:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796870400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788509613.276585:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788509613.276593:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509613.276601:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509613.276610:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788509613.276613:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcc870ca000 from 9 10000000:01000000:3.0:1788509613.276616:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788509613.276635:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509613.276662:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509613.276671:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509613.276686:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796870528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788509613.276710:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509613.276726:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1788509613.276738:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796870528 00000100:00100000:3.0:1788509613.276742:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796870528 00000100:00100000:3.0:1788509613.276765:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788509613.276771:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+20:17142:x1875387796870528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509613.276779:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509613.276790:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dec3a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509613.276806:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dec3a expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509613.276816:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dec3a expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509613.276823:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdbd3d9200, rc 0) 00000100:00100000:3.0:1788509613.276851:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796870528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509613.276856:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788509613.276914:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796870528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509613.276926:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509613.276934:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509613.276970:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796870656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788509613.287177:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509613.287216:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796870656 00000100:00100000:3.0:1788509613.287224:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796870656 00000100:00100000:3.0:1788509613.287271:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788509613.287281:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796870656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788509613.287306:0:17139:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788509613.287326:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788509613.287329:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788509613.287408:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796870656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509613.287416:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788509613.287455:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd828ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1788509613.287475:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796870656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788509613.287534:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788509613.287543:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509613.287553:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509613.974722:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509614.998460:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788509615.410380:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788509616.022040:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509617.048197:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788509617.366121:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509617.366127:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509617.366129:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509617.366139:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509617.366157:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509617.366160:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509617.366162:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509617.366165:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788509617.366201:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796870784:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366275:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.366319:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796871296:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366346:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.366371:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509617.366377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796871168:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366401:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.366431:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796870912:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366452:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.366468:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796871424:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366492:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.366508:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788509617.366513:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796871040:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.366551:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796871552:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366574:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.366601:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796870784 00000100:00100000:2.0:1788509617.366608:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796870784 00000100:00100000:2.0:1788509617.366671:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788509617.366680:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3647:x1875387796870784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366729:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3647:x1875387796870784:12345-0@lo:400:kworker.0 Request processed in 49us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509617.366736:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788509617.366782:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796871296 00000100:00100000:2.0:1788509617.366786:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796871296 00000100:00100000:2.0:1788509617.366804:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796871424 00000100:00100000:2.0:1788509617.366806:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796871424 00000100:00100000:2.0:1788509617.366835:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796871040 00000100:00100000:2.0:1788509617.366838:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796871040 00000100:00100000:2.0:1788509617.366847:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796871552 00000100:00100000:2.0:1788509617.366849:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796871552 00000100:00080000:0.0:1788509617.366861:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509617.366865:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509617.366866:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509617.366871:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796871296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366920:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796871296:12345-0@lo:400:kworker.0 Request processed in 49us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509617.366927:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509617.366940:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788509617.366946:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796871424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.366979:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796871424:12345-0@lo:400:kworker.0 Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509617.366984:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788509617.366994:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788509617.367000:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796871040:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788509617.367001:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcdb787ed80 x1875387796871424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509617.367015:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796871424:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.367023:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796871040:12345-0@lo:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509617.367035:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788509617.367044:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcdb787c700 x1875387796871040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509617.367046:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788509617.367051:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796871552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509617.367053:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796871040:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.367078:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796871552:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509617.367084:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788509617.367085:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcdb787f480 x1875387796871552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509617.367093:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796871552:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.367111:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796871168 00000100:00100000:2.0:1788509617.367115:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796871168 00000100:00100000:2.0:1788509617.367137:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796870912 00000100:00100000:2.0:1788509617.367139:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796870912 00000100:00100000:2.0:1788509617.367152:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509617.367158:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796871168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.367190:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796871168:12345-0@lo:400:kworker.0 Request processed in 31us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509617.367195:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509617.367212:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788509617.367217:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796870912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.367255:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796870912:12345-0@lo:400:kworker.0 Request processed in 37us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509617.367260:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788509617.367292:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796871680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509617.367315:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.367341:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796871680 00000100:00100000:2.0:1788509617.367344:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796871680 00000100:00100000:2.0:1788509617.367364:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788509617.367370:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796871680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509617.367412:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788509617.367447:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796871680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509617.367454:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788509617.367464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796870912:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.367482:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796871680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509617.367502:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796871168:0@lo:400:kworker.0 00000100:00100000:2.0:1788509617.367511:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796870784:0@lo:400:kworker.0 00010000:00080000:2.0:1788509617.367521:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcdb787ca80 x1875387796871296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509617.367530:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796871296:0@lo:400:kworker.0 00000100:00100000:0.0:1788509617.368198:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788509617.368210:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796871808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509617.368248:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509617.368375:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796871808 00000100:00100000:2.0:1788509617.368380:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796871808 00000100:00100000:3.0:1788509617.368441:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788509617.368450:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796871808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509617.368471:0:17886:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788509617.368551:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796871808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509617.368557:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509617.368601:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796871808:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788509618.071431:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788509618.201655:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788509618.876187:0:19014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788509619.100055:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788509619.895891:0:19066:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788509619.896128:0:19066:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788509620.119080:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788509620.803533:0:19116:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509620.805373:0:19116:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788509621.142060:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509621.269983:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509606/real 1788509606] req@ffff8bcc87356680 x1875387796864000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509621.270012:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87356680 x1875387796864000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509621.270021:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509606/real 1788509606] req@ffff8bcc87357800 x1875387796864128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509621.270031:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87357800 x1875387796864128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788509621.270063:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd91375800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509621.270080:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788509621.270084:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796864000:0@lo:8:kworker.0 00000100:00080000:0.0:1788509621.270089:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509621.270093:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788509621.270096:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796864128:0@lo:8:kworker.0 00000100:00080000:2.0:1788509621.271512:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509621.271517:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509621.271520:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509621.271523:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509621.271544:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509621.271548:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788509621.271552:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcd91375800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509621.271558:0:485:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1788509621.271564:0:485:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788509621.271582:0:485:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8bcd91375800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509621.271635:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc88565c00 x1875387796872448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788509621.271650:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509621.271653:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788509621.271655:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509621.271658:0:485:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1788509621.271661:0:485:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788509621.271664:0:485:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8bcdb47be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509621.271676:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc88564e00 x1875387796872576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509621.271729:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796872064:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.271793:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509621.271833:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796872832:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.271857:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509621.271880:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788509621.271886:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796871936:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.271941:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509621.271961:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796872704:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.271984:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509621.272010:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796872192:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272031:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509621.272048:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796872960:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272066:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509621.272087:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788509621.272093:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796872320:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272114:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509621.272142:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796872832 00000100:00100000:2.0:1788509621.272149:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796872832 00000100:00100000:2.0:1788509621.272189:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796872704 00000100:00100000:2.0:1788509621.272192:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796872704 00000100:00100000:2.0:1788509621.272217:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796872192 00000100:00100000:2.0:1788509621.272220:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796872192 00000100:00100000:2.0:1788509621.272231:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796872960 00000100:00100000:2.0:1788509621.272234:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796872960 00000100:00100000:2.0:1788509621.272248:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788509621.272257:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796872832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272309:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796872832:12345-0@lo:400:kworker.0 Request processed in 53us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509621.272316:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788509621.272333:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509621.272340:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796872704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272368:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796872704:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509621.272373:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788509621.272384:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788509621.272390:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796872192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272421:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796872192:12345-0@lo:400:kworker.0 Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509621.272427:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788509621.272439:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509621.272446:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796872960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272484:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796872960:12345-0@lo:400:kworker.0 Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509621.272490:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509621.272526:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796872064 00000100:00100000:2.0:1788509621.272530:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796872064 00000100:00100000:2.0:1788509621.272554:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796872320 00000100:00100000:2.0:1788509621.272557:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796872320 00000100:00100000:2.0:1788509621.272573:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788509621.272578:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796872064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272623:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796872064:12345-0@lo:400:kworker.0 Request processed in 44us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509621.272629:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788509621.272645:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788509621.272651:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796872320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272680:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796872320:12345-0@lo:400:kworker.0 Request processed in 28us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509621.272687:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788509621.272726:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509621.272731:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509621.272734:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796872320:0@lo:400:kworker.0 00000100:00100000:0.0:1788509621.272748:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796872448:0@lo:8:kworker.0 00010000:00080000:2.0:1788509621.272752:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc88566d80 x1875387796872192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509621.272764:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796872192:0@lo:400:kworker.0 00010000:00080000:2.0:1788509621.272775:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc88565180 x1875387796872960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509621.272785:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796872960:0@lo:400:kworker.0 00000100:00100000:0.0:1788509621.272793:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509621.272829:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796872576:0@lo:8:kworker.0 00010000:00080000:2.0:1788509621.272833:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc88565500 x1875387796872704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509621.272851:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796872704:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272868:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796872064:0@lo:400:kworker.0 00000100:00100000:0.0:1788509621.272871:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788509621.272884:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc88564380 x1875387796872832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509621.272894:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796872832:0@lo:400:kworker.0 00000100:00100000:2.0:1788509621.272951:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796872448 00000100:00100000:2.0:1788509621.272954:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796872448 00000100:00100000:2.0:1788509621.272984:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796872576 00000100:00100000:2.0:1788509621.272987:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796872576 00000100:00100000:2.0:1788509621.272997:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788509621.273003:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875387796872448:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788509621.273029:0:18650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1788509621.273055:0:18650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310dec48 00002000:00100000:2.0:1788509621.273067:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8bcc863db800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788509621.273071:0:18650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788509621.273074:0:18650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788509621.273242:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788509621.273265:0:18650:0:(import.c:65:import_set_state_nolock()) ffff8bcc863d8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509621.273315:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875387796872448:12345-0@lo:8:kworker.0 Request processed in 310us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509621.273321:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788509621.273336:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509621.273339:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875387796872576:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788509621.273350:0:18650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788509621.273531:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc88565c00 x1875387796872448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788509641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509621.273540:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509621.273547:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788509621.273554:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788509621.273559:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788509621.273561:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd91375800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788509621.273575:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788509621.273579:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796872448:0@lo:8:kworker.0 00000004:00080000:0.0:1788509621.273634:0:17885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788509621.273652:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875387796873216:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788509621.273689:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509621.273704:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd85294480 going to sleep for 11 seconds 00000100:00100000:0.0:1788509621.273720:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788509621.273727:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788509621.273737:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788509621.273746:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796873088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509621.273766:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509621.273808:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796873088 00000100:00100000:0.0:1788509621.273813:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796873088 00000100:00100000:0.0:1788509621.273845:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509621.273862:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796873088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509621.273881:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509621.273937:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796873088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509621.273944:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788509621.273960:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788509621.273976:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc87781180 x1875387796873088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509621.273989:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796873088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509621.275225:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796871936 00000100:00100000:3.0:1788509621.275234:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796871936 00000100:00100000:3.0:1788509621.275285:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788509621.275293:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3645:x1875387796871936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509621.275354:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3645:x1875387796871936:12345-0@lo:400:kworker.0 Request processed in 62us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509621.275360:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788509621.275394:0:18648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788509621.275402:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796873216 00000100:00100000:3.0:1788509621.275405:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796873216 00000004:00080000:3.0:1788509621.275426:0:17884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788509621.275499:0:17884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 518436600204ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788509621.275505:0:17884:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788509621.275625:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796871936:0@lo:400:kworker.0 00000100:00100000:3.0:1788509621.275735:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509621.275742:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1875387796873216:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788509621.285314:0:17876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788509621.287995:0:19129:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788509621.288006:0:19129:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788509621.288101:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1875387796873216:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12355us (14407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509621.288113:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788509621.288453:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc87783800 x1875387796873216/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788509637 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509621.288468:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87783800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875387796873216:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788509621.288482:0:17885:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788509621.288523:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875387796873344:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788509621.288561:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509621.288608:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a9206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509621.289312:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796873344 00000100:00100000:0.0:1788509621.289320:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796873344 00000100:00100000:0.0:1788509621.289375:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788509621.289384:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17885:x1875387796873344:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788509621.289417:0:18648:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788509621.289463:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17885:x1875387796873344:12345-0@lo:5:osp-pre-0-1.0 Request processed in 80us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509621.289469:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788509621.289501:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcdb5c5d180 x1875387796873344/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509637 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509621.289513:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875387796873344:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788509621.289523:0:17885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788509621.289551:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875387796873472:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788509621.289576:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509621.289604:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd85294480 going to sleep for 11 seconds 00000100:00100000:0.0:1788509621.289617:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796873472 00000100:00100000:0.0:1788509621.289621:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796873472 00000100:00100000:0.0:1788509621.292800:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788509621.292812:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17885:x1875387796873472:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788509621.292857:0:18648:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788509621.309470:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875387796872576:12345-0@lo:8:kworker.0 Request processed in 36121us (36595us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788509621.309485:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788509621.309704:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509621.309710:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788509621.309714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796872576:0@lo:8:kworker.0 00000001:00080000:3.0:1788509621.332804:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788509621.332820:0:18645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788509621.333009:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17885:x1875387796873472:12345-0@lo:5:osp-pre-0-1.0 Request processed in 40193us (43426us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788509621.333022:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788509621.333053:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc87781180 x1875387796873472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509637 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509621.333066:0:17885:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788509621.333071:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875387796873472:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788509621.333087:0:17885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788509621.333135:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1875387796873600:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788509621.333170:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509621.333238:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd85294480 going to sleep for 11 seconds 00000100:00100000:1.0:1788509621.333611:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796873600 00000100:00100000:1.0:1788509621.333618:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796873600 00000100:00100000:1.0:1788509621.333663:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788509621.333672:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1875387796873600:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788509621.333732:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1875387796873600:12345-0@lo:900:osp-pre-0-1.0 Request processed in 61us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509621.333739:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788509621.333766:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc87781180 x1875387796873600/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788509637 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509621.333777:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1875387796873600:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788509622.167675:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509622.486449:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796873856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509622.486516:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509622.486547:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509622.486572:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796873728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509622.486608:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509622.486682:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796873856 00000100:00100000:0.0:1788509622.486690:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796873856 00000100:00100000:0.0:1788509622.486737:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796873728 00000100:00100000:0.0:1788509622.486741:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796873728 00000100:00100000:0.0:1788509622.486758:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788509622.486766:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796873856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788509622.486797:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788509622.486839:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796873856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509622.486846:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788509622.486861:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788509622.486867:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796873728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509622.486884:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788509622.487000:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796873728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509622.487006:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788509622.487143:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796873728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509622.487156:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796873856:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509623.190230:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509624.215335:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509625.240593:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509625.687271:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788509626.263837:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788509626.582057:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509626.582063:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509626.582065:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509626.582068:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509626.582103:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509626.582106:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788509626.582110:0:485:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509626.582117:0:485:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 518 00000100:00080000:2.0:1788509626.582123:0:485:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788509626.582129:0:485:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8bcdb47be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509626.582151:0:485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913e5f80 x1875387796874624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509626.582269:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796874240:0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.582332:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509626.582438:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796873984:0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.582474:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509626.582514:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796874496:0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.582539:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509626.582574:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788509626.582581:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796874112:0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.582605:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509626.582621:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796874752:0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.582640:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509626.582678:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796874496 00000100:00100000:0.0:1788509626.582685:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796874496 00000100:00100000:0.0:1788509626.582738:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509626.582747:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796874496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.582795:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796874496:12345-0@lo:400:kworker.0 Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509626.582802:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788509626.582824:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796874112 00000100:00100000:0.0:1788509626.582827:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796874112 00000100:00100000:0.0:1788509626.582852:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788509626.582858:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796874112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.582889:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796874112:12345-0@lo:400:kworker.0 Request processed in 32us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509626.582932:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788509626.582948:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509626.583000:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796874112:0@lo:400:kworker.0 00010000:00080000:0.0:1788509626.583012:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e6680 x1875387796874496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509626.583021:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796874496:0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.583109:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796874880:0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.583135:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509626.583151:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788509626.583157:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796874368:0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.583175:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509626.583203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796875008:0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.583225:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509626.583247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796874624:0@lo:8:kworker.0 00000100:00100000:2.0:1788509626.583270:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509626.583298:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796874240 00000100:00100000:2.0:1788509626.583302:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796874240 00000100:00100000:2.0:1788509626.583321:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796874752 00000100:00100000:2.0:1788509626.583324:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796874752 00000100:00100000:2.0:1788509626.583333:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796874880 00000100:00100000:2.0:1788509626.583335:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796874880 00000100:00100000:0.0:1788509626.583451:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796875008 00000100:00100000:0.0:1788509626.583455:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796875008 00000100:00100000:0.0:1788509626.583475:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788509626.583481:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796874240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.583518:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796874240:12345-0@lo:400:kworker.0 Request processed in 36us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509626.583524:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788509626.583544:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788509626.583551:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796874752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.583596:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796874752:12345-0@lo:400:kworker.0 Request processed in 46us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509626.583603:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788509626.583614:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788509626.583621:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796875008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.583645:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796875008:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509626.583650:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788509626.583674:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e4000 x1875387796874752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509626.583683:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796874752:0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.584547:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788509626.584568:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796874880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.584619:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796874880:12345-0@lo:400:kworker.0 Request processed in 64us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509626.584626:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788509626.584648:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796873984 00000100:00100000:2.0:1788509626.584652:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796873984 00000100:00100000:2.0:1788509626.584682:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788509626.584688:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3646:x1875387796873984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.584723:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3646:x1875387796873984:12345-0@lo:400:kworker.0 Request processed in 34us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509626.584729:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788509626.584770:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796874368 00000100:00100000:2.0:1788509626.584774:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796874368 00000100:00100000:2.0:1788509626.584800:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788509626.584806:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796874368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509626.584836:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796874368:12345-0@lo:400:kworker.0 Request processed in 30us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509626.584853:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788509626.584879:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796874624 00000100:00100000:2.0:1788509626.584883:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796874624 00000100:00100000:2.0:1788509626.584934:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788509626.584939:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875387796874624:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788509626.584958:0:18650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788509626.588683:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509626.588691:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509626.588709:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796875136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788509626.588781:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509626.588835:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796873984:0@lo:400:kworker.0 00000100:00100000:3.0:1788509626.588883:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796874368:0@lo:400:kworker.0 00010000:00080000:3.0:1788509626.588916:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e5500 x1875387796875008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509626.588926:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796875008:0@lo:400:kworker.0 00010000:00080000:3.0:1788509626.588939:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e4380 x1875387796874240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509626.588946:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796874240:0@lo:400:kworker.0 00010000:00080000:3.0:1788509626.588962:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e4e00 x1875387796874880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509626.588989:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796874880:0@lo:400:kworker.0 00000100:00100000:0.0:1788509626.589213:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796875136 00000100:00100000:0.0:1788509626.589221:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796875136 00000100:00100000:0.0:1788509626.589275:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509626.589285:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796875136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509626.589313:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509626.589370:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796875136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509626.589377:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788509626.589406:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd87c6b800 x1875387796875136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509626.589420:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796875136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509626.600654:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875387796874624:12345-0@lo:8:kworker.0 Request processed in 15706us (17374us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788509626.600668:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788509626.603002:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509626.603013:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788509626.603018:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796874624:0@lo:8:kworker.0 00010000:00010000:2.0:1788509627.286066:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788509627.310829:0:19462:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788509627.310833:0:19462:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788509627.310835:0:19462:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788509627.311235:0:19462:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bcc870b2800 00000020:01000004:3.0:1788509627.311251:0:19462:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788509627.311265:0:19462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788509627.311279:0:19462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8bcd97e73380) 00000020:00000080:3.0:1788509627.311295:0:19462:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788509627.416126:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788509627.418150:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788509627.422546:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788509627.425327:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788509627.426244:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788509627.426725:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788509627.427917:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1788509627.431189:0:19462:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788509627.431506:0:19462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788509627.431538:0:19462:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788509627.431567:0:19462:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe5156b86310dec56 00000020:01000004:1.0:1788509627.431576:0:19462:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788509627.431603:0:19462:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788509627.431608:0:19462:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788509627.431616:0:19462:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788509627.431654:0:19462:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788509627.431660:0:19462:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788509627.447750:0:19462:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788509627.447804:0:19462:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788509627.447809:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788509627.447811:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788509627.447812:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509627.447813:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509627.447815:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509627.447816:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509627.447817:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509627.447820:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509627.447822:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788509627.447826:0:19462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788509627.447829:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788509627.447830:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788509627.447831:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509627.447833:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509627.447834:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509627.447835:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509627.447836:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509627.447837:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509627.447838:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788509627.447873:0:19462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788509627.448019:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788509627.448115:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.448213:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6271540 going to sleep for 11 seconds 00000100:00100000:1.0:1788509627.448256:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796875264 00000100:00100000:1.0:1788509627.448266:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796875264 00000100:00100000:1.0:1788509627.448379:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788509627.448400:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:19462:x1875387796875264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788509627.448443:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788509627.448446:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788509627.448450:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788509627.448983:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:19462:x1875387796875264:12345-0@lo:253:mount.lustre.0 Request processed in 584us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509627.448993:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788509627.449085:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788509627.449098:0:19462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788509627.449101:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788509627.449103:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788509627.449104:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509627.449105:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509627.449106:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509627.449107:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509627.449109:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509627.449110:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509627.449111:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788509627.449135:0:19462:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bcc870b2800 from lustre-OST0001 10000000:01000000:0.0:1788509627.449165:0:19462:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788509627.449175:0:19462:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788509627.449187:0:19462:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bcdb4623380 local copy 00010000:00010000:0.0:1788509627.449199:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.449312:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509627.449344:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.449488:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788509627.449573:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796875392 00000100:00100000:2.0:1788509627.449579:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796875392 00000100:00100000:2.0:1788509627.449606:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788509627.449612:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:19462:x1875387796875392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509627.449690:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:19462:x1875387796875392:12345-0@lo:501:mount.lustre.0 Request processed in 77us (345us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509627.449696:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788509627.449766:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875392:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788509627.449778:0:19462:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788509627.449794:0:19462:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788509627.449800:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.449809:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce3a00/0xe5156b86310de970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310de977 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509627.449835:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bcc870b2800 10000000:01000000:0.0:1788509627.449840:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788509627.449846:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788509627.449849:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788509627.449853:0:19462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788509627.449857:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788509627.449891:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fc00/0xe5156b86310dec5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.449924:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fc00/0xe5156b86310dec5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.449945:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fc00/0xe5156b86310dec5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.449958:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788509627.449985:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.450004:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb59b6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788509627.450113:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796875520 00000100:00100000:2.0:1788509627.450117:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796875520 00000100:00100000:2.0:1788509627.450135:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788509627.450140:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:19462:x1875387796875520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788509627.450149:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509627.450163:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc87ce2a00/0xe5156b86310dec64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dec5d expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509627.450187:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc87ce2a00/0xe5156b86310dec64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dec5d expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509627.450206:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc87ce2a00/0xe5156b86310dec64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dec5d expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509627.450217:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc87ce2a00, rc 0) 00000100:00100000:2.0:1788509627.450243:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796875520:12345-0@lo:101:mount.lustre.0 Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.450249:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788509627.450333:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788509627.450346:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fc00/0xe5156b86310dec5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec64 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.450356:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fc00/0xe5156b86310dec5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dec64 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788509627.451265:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788509627.451858:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788509627.456214:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788509627.456285:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788509627.456299:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788509627.456310:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788509627.456323:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788509627.456335:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788509627.456363:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788509627.456369:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788509627.456505:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509627.456603:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.456651:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5980300 going to sleep for 11 seconds 00000100:00100000:3.0:1788509627.456842:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796875648 00000100:00100000:3.0:1788509627.456852:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796875648 00000100:00100000:3.0:1788509627.457026:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788509627.457038:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796875648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509627.457233:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796875648:12345-0@lo:501:mount.lustre.0 Request processed in 197us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509627.457242:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788509627.457702:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788509627.457761:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509627.457806:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.457841:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5980300 going to sleep for 11 seconds 00000100:00100000:3.0:1788509627.457970:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796875776 00000100:00100000:3.0:1788509627.457976:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796875776 00000100:00100000:3.0:1788509627.458014:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788509627.458022:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796875776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788509627.458705:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796875776:12345-0@lo:503:mount.lustre.0 Request processed in 681us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509627.458715:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788509627.458805:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788509627.459395:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788509627.459489:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788509627.459542:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.459593:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788509627.459661:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796875904 00000100:00100000:1.0:1788509627.459668:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796875904 00000100:00100000:1.0:1788509627.459715:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788509627.459724:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796875904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788509627.460178:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796875904:12345-0@lo:502:mount.lustre.0 Request processed in 455us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509627.460186:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788509627.460264:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796875904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788509627.460456:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788509627.460482:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788509627.460510:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788509627.460524:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788509627.460537:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788509627.460562:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788509627.460577:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788509627.460588:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788509627.460599:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788509627.460623:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788509627.460661:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.460744:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788509627.460784:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796876032 00000100:00100000:3.0:1788509627.460789:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796876032 00000100:00100000:3.0:1788509627.460830:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788509627.460840:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796876032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509627.462155:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796876032:12345-0@lo:502:mount.lustre.0 Request processed in 1312us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509627.462168:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788509627.462215:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788509627.462308:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788509627.462327:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788509627.462974:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788509627.462985:0:19466:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788509627.462993:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788509627.462995:0:19466:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788509627.463001:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788509627.463021:0:19466:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8bcdb0e219c0) 00000020:00000080:2.0:1788509627.463051:0:19466:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788509627.463058:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788509627.463138:0:19466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcc870b2800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788509627.463147:0:19466:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788509627.463155:0:19466:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe5156b86310dec72 00010000:00010000:2.0:1788509627.466229:0:19466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788509627.466694:0:19466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788509627.467979:0:19466:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788509627.469615:0:19466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788509627.469630:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509627.469638:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509627.469640:0:19466:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788509627.469644:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509627.469649:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509627.469650:0:19466:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788509627.469654:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788509627.469656:0:19466:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788509627.469658:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509627.469661:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509627.469663:0:19466:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788509627.469665:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788509627.469667:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509627.469669:0:19466:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788509627.469673:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788509627.469713:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788509627.469717:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788509627.469718:0:19466:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788509627.469721:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788509627.471350:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788509627.471398:0:19462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788509627.471428:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fc00/0xe5156b86310dec5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec64 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509627.471444:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fc00/0xe5156b86310dec5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec64 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509627.471455:0:19462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcc870b2800 from 1 10000000:01000000:1.0:1788509627.471459:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788509627.471514:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509627.471561:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509627.471576:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509627.471609:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788509627.471819:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509627.471886:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e413f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509627.472108:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796876160 00000100:00100000:0.0:1788509627.472119:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796876160 00000100:00100000:0.0:1788509627.472183:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788509627.472195:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+22:19462:x1875387796876160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788509627.472211:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509627.472235:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dec79 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.472267:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dec79 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.472279:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dec79 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.472291:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846e800, rc 0) 00000100:00100000:0.0:1788509627.472340:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876160:12345-0@lo:101:mount.lustre.0 Request processed in 146us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.472348:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788509627.472461:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509627.472480:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509627.472490:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788509627.477392:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788509627.479328:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509627.479688:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788509627.479722:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788509627.479743:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788509627.479758:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788509627.480394:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509627.480478:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509627.480524:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a024e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509627.480726:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796876288 00000100:00100000:2.0:1788509627.480735:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796876288 00000100:00100000:2.0:1788509627.480793:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788509627.480806:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509627.481026:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876288:12345-0@lo:501:mount.lustre.0 Request processed in 222us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.481036:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788509627.481796:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509627.481845:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788509627.482134:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509627.482281:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a024e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509627.482448:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796876416 00000100:00100000:0.0:1788509627.482456:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796876416 00000100:00100000:0.0:1788509627.482510:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788509627.482519:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788509627.483692:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876416:12345-0@lo:503:mount.lustre.0 Request processed in 1167us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.483712:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788509627.483797:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788509627.484396:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788509627.484506:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509627.484588:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509627.484638:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a024e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509627.484941:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796876544 00000100:00100000:2.0:1788509627.484948:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796876544 00000100:00100000:2.0:1788509627.484987:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788509627.484994:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509627.485108:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876544:12345-0@lo:502:mount.lustre.0 Request processed in 114us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.485114:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788509627.485535:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788509627.485771:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788509627.485801:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788509627.485813:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788509627.485824:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788509627.485834:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788509627.485845:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788509627.485857:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788509627.485869:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788509627.486260:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788509627.486294:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788509627.486302:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788509627.486330:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788509627.486385:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.486419:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509627.486995:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796876672 00000100:00100000:2.0:1788509627.487004:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796876672 00000100:00100000:2.0:1788509627.487294:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788509627.487303:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509627.487427:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876672:12345-0@lo:502:mount.lustre.0 Request processed in 126us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.487433:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788509627.487538:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788509627.487603:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788509627.487611:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788509627.488539:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509627.488561:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509627.488564:0:19470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788509627.488571:0:19470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcc870b2800 00000020:00000080:0.0:1788509627.488573:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788509627.488583:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509627.488585:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509627.488586:0:19470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788509627.488587:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509627.488589:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509627.488590:0:19470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788509627.488592:0:19470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bcc870b2800 00000020:00000080:0.0:1788509627.488593:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788509627.488653:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509627.488655:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509627.488656:0:19470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788509627.488657:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509627.488658:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509627.488659:0:19470:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788509627.488661:0:19470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcc870b2800 00000020:00000080:0.0:1788509627.488663:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788509627.488672:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509627.488684:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509627.488685:0:19470:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788509627.488686:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788509627.488688:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509627.488689:0:19470:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788509627.488690:0:19470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bcc870b2800 00000020:00000080:0.0:1788509627.488692:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788509627.488790:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788509627.488793:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788509627.488795:0:19470:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788509627.488797:0:19470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788509627.489023:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788509627.489240:0:19462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788509627.489301:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.489315:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509627.489390:0:19462:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788509627.489394:0:19462:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bcc870b2800 10000000:01000000:3.0:1788509627.489397:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bcc870b2800 10000000:01000000:3.0:1788509627.489402:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788509627.489409:0:19462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bcc870b2800 from 1 10000000:01000000:3.0:1788509627.489412:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788509627.489467:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dec87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.489478:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dec87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.489490:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dec87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509627.489517:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788509627.489604:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509627.489662:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a024e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509627.489747:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796876800 00000100:00100000:1.0:1788509627.489756:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796876800 00000100:00100000:1.0:1788509627.489816:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788509627.489826:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+23:19462:x1875387796876800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788509627.489842:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509627.489858:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862af800/0xe5156b86310dec8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dec87 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509627.489884:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862af800/0xe5156b86310dec8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dec87 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509627.489932:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862af800/0xe5156b86310dec8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dec87 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509627.489943:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af800, rc 0) 00000100:00100000:1.0:1788509627.489987:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796876800:12345-0@lo:101:mount.lustre.0 Request processed in 162us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509627.489994:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788509627.490257:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788509627.490274:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dec87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec8e expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.490285:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dec87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dec8e expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788509627.493733:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788509627.494394:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509627.494681:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788509627.494731:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788509627.494758:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788509627.494776:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788509627.494799:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788509627.494816:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788509627.494835:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788509627.494852:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788509627.494871:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788509627.494934:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788509627.494952:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788509627.494967:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788509627.494982:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788509627.494998:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788509627.495014:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788509627.495030:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788509627.495044:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788509627.495081:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788509627.495093:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788509627.495101:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788509627.495108:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788509627.495115:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788509627.495121:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788509627.495128:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788509627.495136:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788509627.495143:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788509627.495150:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788509627.495156:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788509627.495165:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788509627.495175:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788509627.495182:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788509627.495189:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788509627.495197:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788509627.495220:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788509627.495232:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788509627.495247:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788509627.495255:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788509627.495264:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788509627.495276:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788509627.495294:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788509627.495314:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788509627.495335:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788509627.495364:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788509627.495380:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788509627.495399:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788509627.495411:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788509627.495429:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788509627.495433:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788509627.495564:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509627.495658:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509627.495724:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a0243c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509627.496401:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796876928 00000100:00100000:2.0:1788509627.496410:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796876928 00000100:00100000:2.0:1788509627.496465:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788509627.496475:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796876928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788509627.496681:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796876928:12345-0@lo:501:mount.lustre.0 Request processed in 206us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.496689:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788509627.496804:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796876928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788509627.496850:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796877056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788509627.497011:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509627.497042:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796877056 00000100:00100000:3.0:1788509627.497046:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796877056 00000100:00100000:3.0:1788509627.497462:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788509627.497473:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796877056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788509627.497593:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796877056:12345-0@lo:503:mount.lustre.0 Request processed in 122us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509627.497600:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788509627.497655:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a0243c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509627.497669:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796877056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788509627.498433:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788509627.498542:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796877184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509627.498637:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509627.498675:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcda6363900 going to sleep for 11 seconds 00000100:00100000:2.0:1788509627.498814:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796877184 00000100:00100000:2.0:1788509627.498821:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796877184 00000100:00100000:2.0:1788509627.498870:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788509627.498880:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796877184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788509627.499148:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796877184:12345-0@lo:502:mount.lustre.0 Request processed in 269us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.499166:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788509627.499693:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796877184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788509627.500023:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788509627.500055:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788509627.500084:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788509627.500097:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788509627.500108:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788509627.500120:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788509627.500131:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788509627.500141:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788509627.500151:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788509627.500163:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788509627.500175:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788509627.500186:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788509627.500197:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788509627.500209:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788509627.500220:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788509627.500231:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788509627.500257:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788509627.500270:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788509627.500281:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788509627.500293:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788509627.500305:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788509627.500316:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788509627.500327:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788509627.500339:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788509627.500351:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788509627.500362:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788509627.500375:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788509627.500389:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788509627.500402:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788509627.500417:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788509627.500430:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788509627.500445:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788509627.500479:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788509627.500503:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788509627.500525:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788509627.500561:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788509627.500587:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788509627.500608:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788509627.500628:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788509627.500645:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788509627.500661:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788509627.500680:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788509627.500697:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788509627.500709:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788509627.500722:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788509627.500734:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788509627.500746:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788509627.500762:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788509627.500828:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796877312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509627.500974:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509627.501026:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a024e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509627.501131:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796877312 00000100:00100000:0.0:1788509627.501138:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796877312 00000100:00100000:0.0:1788509627.501193:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788509627.501203:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796877312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788509627.501323:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796877312:12345-0@lo:502:mount.lustre.0 Request processed in 121us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.501332:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788509627.501430:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796877312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788509627.501596:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788509627.501617:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788509627.501639:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796877440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509627.501675:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509627.501704:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796877440 00000100:00100000:2.0:1788509627.501709:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796877440 00000100:00100000:2.0:1788509627.501743:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788509627.501750:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796877440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788509627.501783:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a024e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509627.501822:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796877440:12345-0@lo:502:mount.lustre.0 Request processed in 72us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.501829:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788509627.501831:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796877440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788509627.501863:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788509627.501871:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788509627.502747:0:19475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788509627.502783:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8bcc8747cd40) 00000020:00000080:3.0:1788509627.502813:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788509627.502959:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcc870b2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788509627.502966:0:19475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcc870b2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788509627.502969:0:19475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcc870b2800 3 00010000:00080000:3.0:1788509627.503009:0:19475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc87586800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788509627.504846:0:19475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788509627.508235:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788509627.508390:0:19475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788509627.508408:0:19475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe5156b86310dec9c 00000100:00080000:2.0:1788509627.508424:0:19475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788509627.508432:0:19475:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bcc87586800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509627.508482:0:19475:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913e4a80 x1875387796877568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788509627.508573:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796877568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788509627.508681:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509627.508782:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796877568 00000100:00100000:2.0:1788509627.508793:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796877568 00000100:00100000:2.0:1788509627.508837:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788509627.508847:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796877568:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788509627.508877:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:2.0:1788509627.508962:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe5156b86310deca3 00000004:00100000:2.0:1788509627.508982:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788509627.509038:0:17145:0:(import.c:65:import_set_state_nolock()) ffff8bcc860cc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509627.509201:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875387796877568:12345-0@lo:38:llog_process_th.0 Request processed in 352us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.509209:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788509627.509220:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e4a80 x1875387796877568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509627.509231:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788509627.509239:0:19475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788509627.509241:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788509627.509249:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788509627.509254:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788509627.509256:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc87586800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788509627.509264:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875387796877568:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788509627.509339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788509627.509343:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788509627.509347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788509627.509350:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788509627.509392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788509627.509395:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788509627.509397:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788509627.509402:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:0.0:1788509627.509406:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788509627.509411:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8bcdb47be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509627.509413:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796877952:0@lo:400:kworker.0 00000100:00100000:0.0:1788509627.509427:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc87ea4380 x1875387796878208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509627.509452:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.509470:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796877696:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509476:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796878592:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509496:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.509498:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509627.509515:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788509627.509515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796878336:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509520:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796877824:0@lo:400:kworker.0 00000100:00100000:0.0:1788509627.509534:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.509564:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788509627.509569:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796878080:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509582:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796877952 00000100:00100000:2.0:1788509627.509588:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796877952 00000100:00100000:0.0:1788509627.509594:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509627.509622:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796877696 00000100:00100000:2.0:1788509627.509625:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796877696 00000100:00100000:0.0:1788509627.509626:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796878080 00000100:00100000:0.0:1788509627.509629:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796878080 00000100:00100000:2.0:1788509627.509642:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788509627.509648:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796877952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509627.509657:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788509627.509663:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796878080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509691:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796877952:12345-0@lo:400:kworker.0 Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.509695:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796878080:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.509698:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788509627.509707:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788509627.509714:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788509627.509719:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796877696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509627.509731:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796878208:0@lo:8:kworker.0 00000100:00100000:2.0:1788509627.509746:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796877696:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.509752:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788509627.509754:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509627.509772:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796878592 00000100:00100000:2.0:1788509627.509776:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796878592 00010000:00080000:0.0:1788509627.509784:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcdb787df80 x1875387796878080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509627.509795:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796878080:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509799:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796878336 00000100:00100000:2.0:1788509627.509801:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796878336 00000100:00100000:0.0:1788509627.509804:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796877696:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509816:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788509627.509822:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796878592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509863:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796878592:12345-0@lo:400:kworker.0 Request processed in 40us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.509870:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788509627.509883:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788509627.509889:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796878336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.509959:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796878336:12345-0@lo:400:kworker.0 Request processed in 70us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.509965:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788509627.509988:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc87ea4a80 x1875387796878336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509627.509994:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.509999:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796878336:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.510012:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796878464:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.510036:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788509627.510057:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc87ea4000 x1875387796878592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509627.510066:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796878592:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.510077:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796877952:0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.510090:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796877824 00000100:00100000:2.0:1788509627.510092:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796877824 00000100:00100000:2.0:1788509627.510106:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796878464 00000100:00100000:2.0:1788509627.510107:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796878464 00000100:00100000:2.0:1788509627.510115:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788509627.510118:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796877824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.510140:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796877824:12345-0@lo:400:kworker.0 Request processed in 22us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.510143:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788509627.510150:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788509627.510159:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796878464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509627.510178:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875387796878464:12345-0@lo:400:kworker.0 Request processed in 20us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.510182:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788509627.510200:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcdb787c700 x1875387796877824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509627.510207:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796877824:0@lo:400:kworker.0 00010000:00080000:2.0:1788509627.510213:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcc87ea5500 x1875387796878464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509627.510217:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875387796878464:0@lo:400:kworker.0 00000020:01000004:2.0:1788509627.510273:0:19475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788509627.510290:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8bcdb0e23380) 00000020:00000080:2.0:1788509627.510307:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788509627.510383:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bcc870b2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788509627.510386:0:19475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bcc870b2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788509627.510389:0:19475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bcc870b2800 3 00010000:00080000:2.0:1788509627.510421:0:19475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bcc860c9000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.112@tcp at head 00000100:00100000:3.0:1788509627.510431:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796878208 00000100:00100000:3.0:1788509627.510437:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796878208 00000100:00100000:3.0:1788509627.510475:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788509627.510482:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875387796878208:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788509627.510564:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875387796878208:12345-0@lo:8:kworker.0 Request processed in 81us (808us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788509627.510572:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509627.510612:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788509627.510620:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788509627.510624:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788509627.510628:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796878208:0@lo:8:kworker.0 00010000:00010000:2.0:1788509627.514293:0:19475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788509627.514544:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788509627.514615:0:19475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788509627.514632:0:19475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe5156b86310decb1 00000100:00080000:2.0:1788509627.514642:0:19475:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788509627.514650:0:19475:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8bcc860c9000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509627.514691:0:19475:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcd913e4380 x1875387796878720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788509627.514746:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875387796878720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788509627.514825:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509627.514886:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796878720 00000100:00100000:2.0:1788509627.514894:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796878720 00000100:00100000:2.0:1788509627.514973:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509627.514980:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875387796878720:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788509627.515006:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:2.0:1788509627.515042:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe5156b86310decb8 00000004:00100000:2.0:1788509627.515059:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788509627.515097:0:17145:0:(import.c:65:import_set_state_nolock()) ffff8bcc860cb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509627.515150:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875387796878720:12345-0@lo:38:llog_process_th.0 Request processed in 168us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.515157:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788509627.515342:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bcd913e4380 x1875387796878720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788509637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509627.515353:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788509627.515361:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788509627.515368:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788509627.515372:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788509627.515374:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc860c9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788509627.515379:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875387796878720:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788509627.515401:0:19475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788509627.515431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509627.515436:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788509627.515440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509627.515454:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788509627.519132:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788509627.519835:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788509627.519878:0:19462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788509627.521675:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dec87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec8e expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.521690:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d9400/0xe5156b86310dec87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dec8e expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788509627.537638:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788509627.537644:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788509627.537652:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509627.537653:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509627.537654:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509627.537656:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509627.537657:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509627.537659:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509627.537660:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788509627.537665:0:19462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788509627.537668:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788509627.537669:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788509627.537671:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509627.537672:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509627.537673:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509627.537674:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509627.537674:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509627.537675:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509627.537676:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788509627.537735:0:19462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788509627.537756:0:19462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796878848:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788509627.537827:0:19462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.537876:0:19462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788509627.537964:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796878848 00000100:00100000:1.0:1788509627.537980:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796878848 00000100:00100000:1.0:1788509627.538356:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788509627.538369:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:19462:x1875387796878848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788509627.538407:0:17139:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788509627.538427:0:17139:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788509627.550224:0:17139:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788509627.550250:0:17139:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788509627.552772:0:17160:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788509627.552781:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788509627.552810:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.552830:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dec2c expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.552838:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dec3a expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.552847:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.552894:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dec3a expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.552936:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dec3a expref: 24 pid: 17138 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.552951:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796878976:0@lo:104: 00000100:00100000:0.0:1788509627.553017:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788509627.553071:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dec2c expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.553079:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dec2c expref: 24 pid: 17139 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.553088:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796879104:0@lo:104: 00000100:00100000:0.0:1788509627.553111:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.553134:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8600bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788509627.553468:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796878976 00000100:00100000:0.0:1788509627.553477:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796878976 00000100:00100000:0.0:1788509627.553520:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796879104 00000100:00100000:0.0:1788509627.553524:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796879104 00000100:00100000:0.0:1788509627.553558:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509627.553569:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:17160:x1875387796878976:12345-0@lo:104: 00010000:00010000:0.0:1788509627.553583:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.553655:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509627.553661:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:17160:x1875387796878976:12345-0@lo:104: Request processed in 94us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.553669:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509627.553691:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509627.553707:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:17160:x1875387796879104:12345-0@lo:104: 00010000:00010000:0.0:1788509627.553717:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.553759:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788509627.553765:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:17160:x1875387796879104:12345-0@lo:104: Request processed in 60us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.553772:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788509627.553783:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788509627.553791:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.553800:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8800 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509627.553804:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.553810:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796878976:0@lo:104: 00010000:00010000:3.0:1788509627.553815:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.553821:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17160:1875387796879104:0@lo:104: 10000000:00010000:3.0:1788509627.553828:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509627.553837:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788509627.553846:0:17160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.553882:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.553934:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509627.553965:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.553972:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcdbd3d8800/0xe5156b86310dec3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.553983:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509627.553986:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.553992:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846fa00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:3.0:1788509627.553995:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.554002:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788509627.554008:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788509627.554014:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788509627.554039:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.554045:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788509627.554051:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.554057:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc8846fa00/0xe5156b86310dec2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec33 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509627.554076:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509627.554077:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509627.554079:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509627.554103:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796879360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509627.554121:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796879232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788509627.554138:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.554157:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509627.554222:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796879360 00000100:00100000:0.0:1788509627.554226:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796879360 00010000:00010000:0.0:1788509627.554243:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dec2c expref: 25 pid: 17139 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.554260:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796879232 00000100:00100000:0.0:1788509627.554262:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796879232 00010000:00010000:0.0:1788509627.554270:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dec3a expref: 26 pid: 17138 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.554281:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509627.554286:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+26:3647:x1875387796879360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509627.554295:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509627.554304:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dec2c expref: 26 pid: 17139 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.554313:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dec2c expref: 26 pid: 17139 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.554325:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc8846f600/0xe5156b86310dec33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dec2c expref: 26 pid: 17139 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.554337:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788509627.554568:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+25:19462:x1875387796878848:12345-0@lo:253:mount.lustre.0 Request processed in 16200us (16739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509627.554581:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788509627.555854:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3647:x1875387796879360:12345-0@lo:103:ldlm_bl.0 Request processed in 1561us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.555864:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509627.555894:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509627.555923:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:3646:x1875387796879232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509627.555939:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509627.555950:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dec3a expref: 23 pid: 17138 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.555968:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dec3a expref: 23 pid: 17138 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.555989:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d9200/0xe5156b86310dec41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dec3a expref: 23 pid: 17138 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556010:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556019:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788509627.556113:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004845795s 00010000:00010000:0.0:1788509627.556118:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556125:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556132:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556139:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556145:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ec00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509627.556149:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556157:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556177:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556491:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509627.556558:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509627.556743:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+22:3646:x1875387796879232:12345-0@lo:103:ldlm_bl.0 Request processed in 822us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.556752:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788509627.556798:0:17160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556820:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509627.556827:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc8846ec00/0xe5156b86310decbf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509627.556870:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796879232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509627.556931:0:19462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:830aae98-6419-4d90-97fb-7d4af2af47a0:19462:1875387796878848:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788509627.556942:0:19462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788509627.556945:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788509627.556947:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788509627.556948:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788509627.556950:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788509627.556951:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788509627.556952:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788509627.556954:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788509627.556955:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788509627.556957:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788509627.556967:0:19462:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788509627.561339:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796879360:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788509627.576222:0:19462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788509627.580704:0:19462:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788509627.580718:0:19462:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788509627.580762:0:19462:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788509627.580818:0:19462:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788509627.580837:0:19462:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788509627.580862:0:19462:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788509627.581883:0:19462:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788509627.582163:0:19462:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788509627.607123:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509627.607154:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796879488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509627.607243:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509627.607296:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796879616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509627.607319:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509627.607359:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796879488 00000100:00100000:2.0:1788509627.607369:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796879488 00000100:00100000:2.0:1788509627.607428:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796879616 00000100:00100000:2.0:1788509627.607431:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796879616 00000100:00100000:2.0:1788509627.607450:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788509627.607506:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788509627.607522:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796879616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788509627.607596:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788509627.607658:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796879616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509627.607666:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788509627.607835:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796879488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509627.607937:0:17886:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788509627.607978:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796879488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509627.607986:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788509627.608035:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796879616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509627.608047:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796879488:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788509628.310211:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788509628.446318:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788509628.545838:0:19529:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788509628.546136:0:19529:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788509628.571878:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509608/real 1788509608] req@ffff8bcc87354000 x1875387796865664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509628 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509628.571938:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87354000 x1875387796865664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509628 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509628.571950:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788509608/real 1788509608] req@ffff8bcc87355880 x1875387796865792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509628 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509628.571961:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bcc87355880 x1875387796865792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788509628 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788509628.571978:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd9f604000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509628.572002:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788509628.572008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796865664:0@lo:8:kworker.0 00000100:00080000:3.0:1788509628.572017:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788509628.572025:0:3643:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788509628.572028:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796865792:0@lo:8:kworker.0 00000100:00100000:0.0:1788509628.576654:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796879744:0@lo:400:kworker.0 00000100:00100000:0.0:1788509628.576759:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788509628.577060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509628.577065:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788509628.577069:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bcd9f604000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509628.577076:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1788509628.577095:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788509628.577105:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bcd9f604000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509628.577138:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc88564e00 x1875387796880000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788509628.577160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509628.577164:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788509628.577166:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788509628.577169:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1788509628.577171:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788509628.577175:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bcc810b5000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509628.577187:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc88564000 x1875387796880128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788509628.577235:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788509628.577239:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788509628.577243:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788509628.577253:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796880000:0@lo:8:kworker.0 00000100:00080000:2.0:1788509628.577254:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8bcdb47be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788509628.577266:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bcc88565500 x1875387796880640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788509628.577459:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796879744 00000100:00100000:1.0:1788509628.577470:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796879744 00000100:00100000:1.0:1788509628.577539:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788509628.577560:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:3646:x1875387796879744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509628.577628:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:3646:x1875387796879744:12345-0@lo:400:kworker.0 Request processed in 71us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509628.577635:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788509628.577780:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796880512:0@lo:400:kworker.0 00000100:00100000:0.0:1788509628.577815:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509628.577846:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796881152:0@lo:400:kworker.0 00000100:00100000:0.0:1788509628.577872:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.578145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.578200:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796880128:0@lo:8:kworker.0 00000100:00100000:3.0:1788509628.578232:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.578262:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796880640:0@lo:8:kworker.0 00000100:00100000:0.0:1788509628.578271:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796879744:0@lo:400:kworker.0 00000100:00100000:0.0:1788509628.578303:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788509628.578311:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796879872:0@lo:400:kworker.0 00000100:00100000:0.0:1788509628.578348:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509628.578374:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796880768:0@lo:400:kworker.0 00000100:00100000:0.0:1788509628.578394:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509628.578412:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796881280:0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.578587:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796880256:0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.578625:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796880384:0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.578650:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.578669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796881024:0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.578699:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796881152 00000100:00100000:2.0:1788509628.578704:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796881152 00000100:00100000:2.0:1788509628.578765:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796880768 00000100:00100000:2.0:1788509628.578769:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796880768 00000100:00100000:2.0:1788509628.578786:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509628.578793:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796881152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509628.578818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509628.578930:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796880512 00000100:00100000:1.0:1788509628.578936:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796880512 00000100:00100000:1.0:1788509628.578969:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796880000 00000100:00100000:1.0:1788509628.578973:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796880000 00000100:00100000:1.0:1788509628.578986:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796880128 00000100:00100000:1.0:1788509628.578989:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796880128 00000100:00100000:1.0:1788509628.579003:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796880640 00000100:00100000:1.0:1788509628.579010:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796880640 00000100:00100000:1.0:1788509628.579021:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509628.579029:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796880512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509628.579189:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.579242:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796881152:12345-0@lo:400:kworker.0 Request processed in 448us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.579250:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788509628.579265:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796881280 00000100:00100000:2.0:1788509628.579269:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796881280 00000100:00100000:2.0:1788509628.579288:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788509628.579294:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796880768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.579325:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796880768:12345-0@lo:400:kworker.0 Request processed in 32us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.579332:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788509628.579342:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788509628.579348:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796881280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.579376:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796881280:12345-0@lo:400:kworker.0 Request processed in 28us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.579381:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788509628.579403:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788509628.579409:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788509628.579411:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509628.579425:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.579868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.579894:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796880896:0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.579956:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.579982:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796881024 00000100:00100000:2.0:1788509628.579987:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796881024 00000100:00100000:2.0:1788509628.580031:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796880256 00000100:00100000:2.0:1788509628.580035:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796880256 00000100:00100000:2.0:1788509628.580046:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796880896 00000100:00100000:2.0:1788509628.580048:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796880896 00000100:00100000:2.0:1788509628.580063:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509628.580069:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796881024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.580117:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796881024:12345-0@lo:400:kworker.0 Request processed in 48us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.580126:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788509628.580152:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788509628.580158:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796880256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.580189:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875387796880256:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.580195:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788509628.580205:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788509628.580211:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796880896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509628.580243:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796880896:12345-0@lo:400:kworker.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509628.580250:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788509628.580259:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788509628.580267:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875387796880000:12345-0@lo:8:kworker.0 00000100:00080000:2.0:1788509628.580285:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509628.580290:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788509628.580322:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc88567b80 x1875387796881024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509628.580339:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796881024:0@lo:400:kworker.0 00010000:00080000:2.0:1788509628.580369:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc88565c00 x1875387796880256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788509628.580381:0:18648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000100:00100000:2.0:1788509628.580405:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875387796880256:0@lo:400:kworker.0 00010000:00080000:2.0:1788509628.580421:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc88566d80 x1875387796880896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1788509628.580428:0:18648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310decc6 00000100:00100000:2.0:1788509628.580433:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796880896:0@lo:400:kworker.0 00002000:00100000:3.0:1788509628.580452:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8bcc87586000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788509628.580460:0:18648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788509628.580463:0:18648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788509628.580929:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796880512:12345-0@lo:400:kworker.0 Request processed in 1896us (3108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509628.580943:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788509628.580975:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509628.580981:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875387796880128:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788509628.581014:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:1.0:1788509628.581047:0:18651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe5156b86310deccd 00002000:00100000:1.0:1788509628.581062:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8bcc86524800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788509628.581068:0:18651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788509628.581071:0:18651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788509628.581432:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788509628.581470:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8bcc87585000 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1788509628.581673:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788509628.581701:0:18651:0:(import.c:65:import_set_state_nolock()) ffff8bcc86521800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788509628.581800:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875387796880000:12345-0@lo:8:kworker.0 Request processed in 1533us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509628.581811:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788509628.581968:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875387796880128:12345-0@lo:8:kworker.0 Request processed in 983us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509628.582034:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788509628.582044:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788509628.582103:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796879872 00000100:00100000:3.0:1788509628.582110:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875387796880640:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788509628.582114:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796879872 00000100:00100000:1.0:1788509628.582169:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796880384 00000100:00100000:1.0:1788509628.582173:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796880384 00000100:00100000:1.0:1788509628.582194:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788509628.582202:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796879872:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788509628.582239:0:18648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000100:00100000:1.0:1788509628.582262:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796879872:12345-0@lo:400:kworker.0 Request processed in 58us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509628.582271:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000020:00000080:3.0:1788509628.582272:0:18648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe5156b86310decd4 00000100:00100000:1.0:1788509628.582293:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788509628.582302:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796880384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509628.582351:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796880384:12345-0@lo:400:kworker.0 Request processed in 50us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509628.582356:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00002000:00100000:3.0:1788509628.582386:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8bcc87584800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788509628.582395:0:18648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788509628.582398:0:18648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788509628.582409:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796880384:0@lo:400:kworker.0 00002000:00080000:3.0:1788509628.582478:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788509628.582500:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8bcc87580800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788509628.582820:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875387796880640:12345-0@lo:8:kworker.0 Request processed in 712us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509628.582829:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788509628.583386:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc88565500 x1875387796880640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788509653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788509628.583403:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788509628.583412:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788509628.583418:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788509628.583421:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcdb47be800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788509628.583440:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788509628.583446:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875387796880640:0@lo:8:kworker.0 00010000:00080000:3.0:1788509628.583465:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc88564e00 x1875387796880000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788509653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509628.583473:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788509628.583479:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788509628.583485:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788509628.583489:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788509628.583491:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcd9f604000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788509628.583511:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788509628.583520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796880000:0@lo:8:kworker.0 00000004:00080000:1.0:1788509628.583538:0:17168:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788509628.583661:0:17168:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 525744761599ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788509628.583668:0:17168:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:3.0:1788509628.583804:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc88564000 x1875387796880128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788509653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509628.583813:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788509628.583821:0:3643:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00010000:00080000:0.0:1788509628.583831:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913d5500 x1875387796881280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509628.583851:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796881280:0@lo:400:kworker.0 00000100:00080000:3.0:1788509628.583855:0:3643:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788509628.583863:0:3643:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788509628.583866:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8bcc810b5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00080000:0.0:1788509628.583875:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc88567480 x1875387796880512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788509628.583893:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788509628.583925:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875387796880128:0@lo:8:kworker.0 00000100:00100000:0.0:1788509628.583939:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796880512:0@lo:400:kworker.0 00010000:00080000:0.0:1788509628.583967:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913d5180 x1875387796881152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509628.583978:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796881152:0@lo:400:kworker.0 00000100:00100000:0.0:1788509628.584015:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796879872:0@lo:400:kworker.0 00010000:00080000:0.0:1788509628.584037:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc88565180 x1875387796880768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788509628.584038:0:17888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788509628.584054:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796880768:0@lo:400:kworker.0 00000100:00100000:3.0:1788509628.584086:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1875387796881536:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788509628.584162:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.584194:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb07b3d80 going to sleep for 11 seconds 00000004:00080000:3.0:1788509628.584216:0:17887:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788509628.584319:0:17887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 525745419553ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788509628.584325:0:17887:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788509628.584376:0:17169:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788509628.584392:0:17169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17169:1875387796881792:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788509628.584417:0:17169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.584434:0:17169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb07b3cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1788509628.584606:0:17171:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788509628.584632:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17171:1875387796882048:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788509628.584688:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509628.584710:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd9e413000 going to sleep for 11 seconds 00000100:00100000:1.0:1788509628.584723:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788509628.584734:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796881920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509628.584759:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509628.584789:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796881536 00000100:00100000:1.0:1788509628.584795:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796881536 00000100:00100000:1.0:1788509628.584837:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796881792 00000100:00100000:1.0:1788509628.584839:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796881792 00000100:00100000:1.0:1788509628.584852:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796882048 00000100:00100000:1.0:1788509628.584854:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796882048 00000100:00100000:1.0:1788509628.584871:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788509628.584880:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1875387796881536:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788509628.585245:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796881920 00000100:00100000:0.0:1788509628.585251:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796881920 00000100:00100000:0.0:1788509628.585294:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788509628.585302:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875387796881920:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788509628.585306:0:17170:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00002000:00000024:0.0:1788509628.585320:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000004:00080000:3.0:1788509628.585379:0:17170:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 525746479907ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788509628.585393:0:17170:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788509628.585395:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875387796881920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509628.585407:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788509628.585424:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796881408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509628.585469:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.585498:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509628.585503:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796881664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509628.585524:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788509628.585613:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509628.585619:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509628.585727:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509628.585740:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17169:x1875387796881792:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788509628.585880:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796881408 00000100:00100000:1.0:1788509628.585888:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796881408 00000100:00100000:1.0:1788509628.585939:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796881664 00000100:00100000:1.0:1788509628.585944:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796881664 00000100:00100000:1.0:1788509628.585967:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509628.585979:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875387796881408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788509628.585994:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:1.0:1788509628.586050:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875387796881408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509628.586057:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788509628.586073:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788509628.586091:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875387796881664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788509628.586108:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788509628.586145:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875387796881664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509628.586153:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788509628.586820:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd87c6b800 x1875387796881664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509628.586846:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796881664:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788509628.588345:0:17124:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788509628.590929:0:17124:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788509628.592780:0:18651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788509628.592797:0:18651:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788509628.592805:0:18651:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00010000:00080000:0.0:1788509628.593224:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb5c5c000 x1875387796881920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509628.593256:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796881920:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1788509628.594408:0:19129:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788509628.594420:0:19129:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000004:00080000:0.0:1788509628.594448:0:17876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788509628.594606:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1875387796881536:12345-0@lo:7:osp-pre-1-1.0 Request processed in 9721us (10452us total) trans 0 rc 0/0 00010000:00080000:0.0:1788509628.594618:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd87c6ad80 x1875387796881536/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788509644 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509628.594623:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788509628.594656:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1875387796881536:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788509628.594665:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1788509628.594673:0:17888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788509628.594682:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17171:x1875387796882048:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788509628.594742:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1875387796882176:0@lo:5:osp-pre-1-1.0 00010000:00080000:3.0:1788509628.594770:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd87c68000 x1875387796881408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788509644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509628.594791:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.594803:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796881408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509628.594823:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002840 going to sleep for 11 seconds 00000100:00100000:0.0:1788509628.594853:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788509628.594862:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788509628.600575:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796882176 00000100:00100000:0.0:1788509628.600593:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796882176 00000100:00100000:1.0:1788509628.601980:0:19531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788509628.601997:0:19531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17888:x1875387796882176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788509628.602037:0:19531:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788509628.602208:0:19531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17888:x1875387796882176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 216us (7419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509628.602217:0:19531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788509628.603262:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87ea5c00 x1875387796882176/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788509644 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509628.603284:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1875387796882176:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788509628.603302:0:17888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788509628.603363:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1875387796882304:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788509628.603416:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509628.603645:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002840 going to sleep for 11 seconds 00002000:00080000:0.0:1788509628.603666:0:19129:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788509628.603673:0:19129:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788509628.603679:0:19129:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:1.0:1788509628.604272:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796882304 00000100:00100000:1.0:1788509628.604284:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796882304 00000100:00100000:1.0:1788509628.604342:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788509628.604351:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17888:x1875387796882304:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788509628.604401:0:18650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1788509628.611788:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.611803:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.611827:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.611833:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.611841:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.611864:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.615355:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.615379:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.615439:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788509628.616215:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.616225:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616243:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.616248:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.616256:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616272:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616282:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616290:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616308:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788509628.616569:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788509628.616578:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616588:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2c00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.616594:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616607:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616636:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616645:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310decdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509628.616661:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.616668:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.616669:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616675:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616681:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.616691:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.616698:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616698:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.616707:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616711:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616727:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616733:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616741:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616744:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310dece2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.616758:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616766:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.616770:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.616770:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.616777:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616783:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3200 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.616787:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616796:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616818:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616826:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310dece9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.616840:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.616842:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.616844:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788509628.617223:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.617232:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.617241:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.617245:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.617250:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.617260:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.617269:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.617282:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.617297:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.617817:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.617825:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.617833:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.617838:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.617846:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.617863:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509628.617864:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.617878:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026f1541e/0xe5156b86310decf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.617932:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.617935:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.617940:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.617952:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.617964:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.617968:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.617974:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.617985:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.617993:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.618001:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.618016:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.618053:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.618058:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.618066:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3e00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.618069:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.618078:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.618090:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.618098:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa2f8c3d/0xe5156b86310decf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.618111:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.618113:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.618115:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.618580:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788509628.618779:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.618787:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.618806:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.618811:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.618816:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.618828:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.618838:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.618846:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.619587:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788509628.620060:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.620070:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.620085:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.620089:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.620095:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.620108:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.620129:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.620136:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621721:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509628.621733:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621749:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226e00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.621754:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621766:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621793:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621814:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005c6ea7d/0xe5156b86310decfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621837:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509628.621842:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621849:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.621852:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621860:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621871:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.621890:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.621893:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.621895:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788509628.622195:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.622204:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622217:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.622222:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509628.622236:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622253:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622263:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622271:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622296:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788509628.622720:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.622726:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622736:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.622739:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509628.622744:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622753:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622761:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622779:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622801:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788509628.622811:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509628.622815:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622822:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.622826:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622834:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622850:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622858:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2cc8f13/0xe5156b86310ded0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622874:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509628.622883:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622919:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846fe00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.622923:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622931:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622943:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622951:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021d534cc/0xe5156b86310ded13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.622964:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.622966:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.622967:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788509628.624672:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.624684:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624702:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.624706:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509628.624713:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624728:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624746:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624754:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624776:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509628.624789:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509628.624794:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624802:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ee00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.624807:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624816:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624834:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624842:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310ded1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.624862:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.624870:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.624872:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.625128:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.626761:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788509628.626780:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310ded05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.626823:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788509628.631310:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788509628.631327:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631349:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1788509628.631363:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509628.631371:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631391:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631404:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631413:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631454:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788509628.631479:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509628.631486:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631495:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.631501:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631512:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631532:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631563:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d29bf9b/0xe5156b86310ded21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.631584:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.631586:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.631588:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.632017:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.632031:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632067:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.632072:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.632079:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632096:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632107:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632115:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788509628.632141:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788509628.632150:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632151:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788509628.632171:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1788509628.632175:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509628.632180:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632191:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632200:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632209:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632229:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788509628.632239:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509628.632256:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632264:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9c00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.632268:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632279:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632294:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632302:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab2765d9/0xe5156b86310ded28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632321:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509628.632324:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632330:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.632334:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632342:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632574:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632583:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c442adce/0xe5156b86310ded2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.632604:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.632608:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.632612:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.632728:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.632738:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632748:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.632752:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.632756:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632766:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632788:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632796:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632815:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.632827:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.632831:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632839:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.632844:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632853:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632870:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632878:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6b722fc/0xe5156b86310ded36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.632916:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.632933:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.632938:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788509628.633193:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788509628.633203:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.633216:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1788509628.633221:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509628.633228:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.633241:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.633250:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.633258:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509628.633266:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.633280:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633293:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.633297:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509628.633304:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.633305:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633320:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633329:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633339:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633355:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.633360:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633369:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862af000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.633385:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633409:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633436:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633444:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008362e0f8/0xe5156b86310ded3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633461:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.633462:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.633464:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.633477:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.633484:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.633487:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633494:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.633496:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633503:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633512:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633525:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007da48221/0xe5156b86310ded44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.633549:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.633551:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.633553:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.633728:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788509628.634961:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788509628.634976:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.634995:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1788509628.635000:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509628.635008:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.635022:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.635033:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.635041:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.635063:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.635168:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.635178:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635189:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afa00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.635195:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635206:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635225:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635233:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000625a17b0/0xe5156b86310ded4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635248:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.635250:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.635252:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.635332:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.635340:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635352:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.635357:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.635363:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635375:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635395:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635404:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635438:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788509628.635529:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.635549:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.635559:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d9200 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.635564:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.635575:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.635595:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.635793:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060fe99f9/0xe5156b86310ded52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.635821:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.635825:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.635828:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.635880:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.635888:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635925:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.635930:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.635934:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635959:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635968:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635976:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.635995:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.636008:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.636014:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636023:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdbd3d8400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.636028:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636038:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636051:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636059:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086f18a62/0xe5156b86310ded59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636083:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.636085:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.636090:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788509628.636181:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788509628.636191:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509628.636415:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.636434:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636443:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.636446:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788509628.636451:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.636452:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636463:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.636468:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.636481:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.636484:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636527:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.636534:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.636569:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636572:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788509628.636584:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.636613:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788509628.636622:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788509628.636629:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636653:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce3200 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.636659:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636668:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636682:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636692:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf9153d9/0xe5156b86310ded67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636709:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.636714:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636733:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862ae200 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.636738:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636748:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636760:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636775:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000773180b3/0xe5156b86310ded60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.636792:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.636794:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.636796:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.637157:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.637164:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.637174:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.637178:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.637183:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.637194:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.637204:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.637212:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.637233:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788509628.638821:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509628.638839:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.638856:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.638861:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.638883:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.638926:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.638952:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116921c7/0xe5156b86310ded6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.638978:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.638980:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.638982:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788509628.639273:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.639282:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639295:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.639300:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509628.639307:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639322:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639332:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639340:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639360:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509628.639369:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509628.639373:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639380:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.639383:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639404:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639417:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639424:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009409c866/0xe5156b86310ded75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.639517:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.639521:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.639523:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788509628.640089:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.640098:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.640111:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.640116:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509628.640121:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509628.640217:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.640243:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640260:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.640265:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.640272:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640286:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640297:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640306:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640330:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509628.640761:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509628.640764:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.640785:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640789:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640828:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.640831:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640835:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.640853:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.640867:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.640869:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.640889:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.641348:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.641366:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509628.641534:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641559:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2c00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.641565:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641578:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641606:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641614:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b52b6ad/0xe5156b86310ded83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641803:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509628.641809:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641818:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030200 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.641830:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641839:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641852:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.641861:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471d8161/0xe5156b86310ded8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509628.641871:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.641880:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.641891:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.641894:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.641921:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.641994:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.642004:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.642012:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.642033:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509628.642311:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509628.642317:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.642326:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.642330:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509628.642340:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.642340:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.642360:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.642369:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.642374:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.642386:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b1f22f8/0xe5156b86310ded91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.642410:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.642412:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.642414:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.642575:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.642582:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.642594:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.642603:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.642611:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643690:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788509628.643711:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509628.643720:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643732:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ec00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.643738:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643751:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.643756:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509628.643771:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643781:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f69e4d6/0xe5156b86310ded7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643807:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509628.643811:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643818:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.643831:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643840:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643852:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.643859:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be94638d/0xe5156b86310ded98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.644178:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.644181:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.644183:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.644840:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.644849:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.644865:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.644888:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.644919:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.644934:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.644945:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.644954:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.644979:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788509628.646704:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.646717:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.646732:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.646738:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.646749:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.646771:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.646780:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006628c4df/0xe5156b86310ded9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.646810:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.646811:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.646813:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.646962:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788509628.647051:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.647058:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.647072:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.647077:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509628.647084:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.647099:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.647122:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.647129:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.647148:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788509628.647401:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.647407:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.647417:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.647420:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.647424:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.647434:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.647506:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.647520:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.647537:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788509628.647762:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788509628.647768:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647776:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846fa00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.647780:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647788:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647805:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647813:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df954a41/0xe5156b86310deda6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647834:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.647838:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647845:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.647848:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647855:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647877:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.647884:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310dedad lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.648013:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.648015:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.648017:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.648684:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.648990:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.648999:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.649017:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.649021:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.649029:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.649043:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.649053:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.649062:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.649079:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788509628.649423:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.649431:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650566:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.650574:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650591:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650616:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650624:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dedb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650668:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.650670:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.650673:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788509628.650785:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.650792:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650805:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.650809:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.650817:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650831:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650841:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650850:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.650874:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509628.651478:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509628.651488:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.651498:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.651502:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.651510:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.651526:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.651534:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022c36a7e/0xe5156b86310dedbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.651578:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.651580:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.651582:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788509628.652851:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.652865:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.652929:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.652935:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.652942:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.652957:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.652969:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.652977:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.652998:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788509628.656082:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509628.656103:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656121:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509628.656128:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656144:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656171:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656179:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f825a6e/0xe5156b86310dedc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656205:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.656207:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509628.656209:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788509628.656522:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788509628.656530:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656571:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1788509628.656576:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788509628.656584:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656597:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656607:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656614:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509628.656635:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788509628.657730:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.657740:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657755:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.657759:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.657766:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657779:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657806:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657814:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657832:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788509628.657844:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788509628.657850:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657858:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ee00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.657863:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657871:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657926:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657935:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db43e9ff/0xe5156b86310dedc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657956:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.657967:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657974:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.657976:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657984:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.657996:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.658004:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098e73e31/0xe5156b86310dedd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.658018:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.658019:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.658021:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.661829:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788509628.662130:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.662144:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662166:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.662171:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.662180:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662214:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662227:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662235:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662256:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788509628.662269:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.662275:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662283:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227c00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.662289:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662299:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662319:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662327:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a34ff2c/0xe5156b86310dedd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.662355:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.662358:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.662360:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.663299:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.663310:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663333:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.663337:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.663343:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663356:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663366:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663374:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663389:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.663398:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.663403:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663411:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.663414:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663422:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663563:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663572:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce896ab9/0xe5156b86310dedde lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.663588:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.663590:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.663592:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.664106:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.664113:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.664125:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.664128:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.664133:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.664144:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.664153:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.664160:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.664229:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788509628.665196:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.665207:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.665222:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.665226:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.665232:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.665244:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.665254:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.665262:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509628.665339:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.665345:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.665354:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.665356:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.665360:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.665370:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.665378:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.665385:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667671:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788509628.667692:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667709:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.667715:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667730:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667756:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667764:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000667bfb87/0xe5156b86310dede5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667790:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509628.667796:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667816:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.667819:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667828:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667841:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667850:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509628.667855:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667861:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.667864:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667871:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667893:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.667922:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.667930:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.667932:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.668057:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788509628.668067:0:19129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dedec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788509628.669991:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.670007:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670035:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.670041:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.670048:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670065:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670077:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670085:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670108:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.670121:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.670127:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670135:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.670140:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670149:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670180:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670189:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be94638d/0xe5156b86310dedfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670210:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.670212:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.670215:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.670753:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.670761:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670773:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.670776:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.670782:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670792:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670801:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670809:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670839:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.670847:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.670851:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670858:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030400 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.670861:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670870:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670966:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670974:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b1f22f8/0xe5156b86310dee01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.670991:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.670993:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.670995:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.671297:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.671304:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671315:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.671325:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.671330:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671341:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671350:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671357:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671372:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.671381:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.671385:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671391:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030200 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.671394:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671402:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671412:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.671430:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.671738:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.671776:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.671779:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.671781:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.672262:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.672269:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672283:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.672288:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.672294:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672305:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672313:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672321:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672376:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788509628.672727:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.672739:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672747:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.672751:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.672755:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672765:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672774:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672781:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672797:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788509628.672807:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788509628.672811:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672819:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.672824:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672834:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672858:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672866:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672967:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.672972:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672979:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.672983:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.672991:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.673001:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.673008:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.673022:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.673024:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.673031:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.676846:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.676869:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.676892:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.676911:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.676919:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.676938:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.676950:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.676959:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.676984:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.677002:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.677008:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.677016:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.677022:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.677045:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.677063:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.677071:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.677095:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.677096:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.677098:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.677681:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788509628.677690:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2687c65/0xe5156b86310dedf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509628.678360:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.678376:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.678392:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.678397:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.678404:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.678420:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.678430:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.678650:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.678724:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788509628.679136:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.679143:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.679153:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.679156:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.679161:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.679171:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.679186:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.679194:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.679201:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788509628.681325:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788509628.681341:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681357:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.681364:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681378:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681406:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681433:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c080cdca/0xe5156b86310dee24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681688:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.681693:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681700:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.681703:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681711:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681723:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681731:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eac3ea8/0xe5156b86310dee2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.681745:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.681747:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.681749:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.681974:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.682599:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.682610:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.682637:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.682642:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.682651:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.682665:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.682675:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.682684:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.683554:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788509628.689841:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788509628.689865:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.689887:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1788509628.689893:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509628.689917:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.689937:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.689949:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.689958:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.690843:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788509628.690858:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.690878:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.690884:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.690910:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.690935:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.690943:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb367d5e/0xe5156b86310dee32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.690975:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788509628.690980:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.690987:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227c00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:1.0:1788509628.690990:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.691012:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.691024:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509628.691032:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.691034:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509628.691036:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.692962:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.693535:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.693555:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693577:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.693582:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.693589:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693606:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693626:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693633:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693655:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.693666:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.693672:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693681:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031600 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.693686:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693695:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693715:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693723:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006628c4df/0xe5156b86310dee40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.693744:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.693754:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.693756:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.694117:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788509628.694126:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a34ff2c/0xe5156b86310dee39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788509628.694756:0:18651:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1788509628.694914:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17169:x1875387796881792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 109154us (110472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509628.694928:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509628.694999:0:17169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17169:1875387796881792:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788509628.695021:0:17169:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788509628.695076:0:17169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17169:1875387796882432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788509628.695120:0:17169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.695157:0:17169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82cd4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788509628.695334:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796882432 00000100:00100000:3.0:1788509628.695343:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796882432 00000100:00100000:3.0:1788509628.695395:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788509628.695405:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17169:x1875387796882432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788509628.695746:0:18648:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 10000000:01000000:2.0:1788509628.698051:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788509628.698060:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcd83147800 from 10 10000000:01000000:2.0:1788509628.698065:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788509628.698120:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227400/0xe5156b86310dee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.698134:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227400/0xe5156b86310dee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.698145:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227400/0xe5156b86310dee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509628.698174:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796882560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788509628.698260:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.698314:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87567600 going to sleep for 11 seconds 00000100:00100000:2.0:1788509628.698494:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796882560 00000100:00100000:2.0:1788509628.698504:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796882560 00000100:00100000:2.0:1788509628.698569:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788509628.698580:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+22:17142:x1875387796882560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509628.698595:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509628.698612:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dee4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dee47 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.698658:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dee4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dee47 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.698671:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227000/0xe5156b86310dee4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dee47 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.698683:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227000, rc 0) 00000100:00100000:2.0:1788509628.698731:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796882560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.698740:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788509628.698843:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796882560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509628.698860:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227400/0xe5156b86310dee47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dee4e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.698870:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227400/0xe5156b86310dee47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dee4e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509628.699803:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796882688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788509628.699865:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.701033:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87567600 going to sleep for 11 seconds 00000100:00100000:1.0:1788509628.701430:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796882688 00000100:00100000:1.0:1788509628.701441:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796882688 00000100:00100000:1.0:1788509628.701503:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788509628.701513:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796882688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788509628.701561:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788509628.701585:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788509628.701589:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788509628.701712:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796882688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 200us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509628.701720:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788509628.701865:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796882688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788509628.703073:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788509628.703087:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227400/0xe5156b86310dee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dee4e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.703100:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb1227400/0xe5156b86310dee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dee4e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788509628.703120:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788509628.703123:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bcc870ca000 from 10 10000000:01000000:2.0:1788509628.703126:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788509628.703168:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226600/0xe5156b86310dee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.703176:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226600/0xe5156b86310dee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.703187:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226600/0xe5156b86310dee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509628.703212:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796882816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788509628.703278:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.703326:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87567600 going to sleep for 11 seconds 00000001:00080000:2.0:1788509628.703532:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788509628.703586:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788509628.703591:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788509628.703622:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796882816 00000100:00100000:2.0:1788509628.703631:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796882816 00000100:00100000:2.0:1788509628.703681:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788509628.703691:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796882816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509628.703705:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509628.703719:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226000/0xe5156b86310dee5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310dee55 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.703746:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226000/0xe5156b86310dee5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310dee55 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.703773:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226000/0xe5156b86310dee5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dee55 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.703783:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226000, rc 0) 00000100:00100000:2.0:1788509628.703828:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:17142:x1875387796882816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.703835:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788509628.708923:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17888:x1875387796882304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 104544us (105476us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788509628.708942:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788509628.709037:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796882816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509628.709071:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226600/0xe5156b86310dee55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dee5c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.709087:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226600/0xe5156b86310dee55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310dee5c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509628.709176:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796882944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788509628.709231:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.709270:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87567600 going to sleep for 11 seconds 00000100:00100000:2.0:1788509628.709304:0:17888:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788509628.709311:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1875387796882304:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788509628.709323:0:17888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788509628.709361:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1875387796883072:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788509628.709389:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509628.709418:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd83002840 going to sleep for 11 seconds 00000100:00100000:2.0:1788509628.709436:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796882944 00000100:00100000:2.0:1788509628.709443:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796882944 00000100:00100000:2.0:1788509628.709492:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788509628.709501:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:17142:x1875387796882944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788509628.709527:0:17139:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788509628.709558:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788509628.709561:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788509628.709645:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:17142:x1875387796882944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.709652:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788509628.709696:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796883072 00000100:00100000:2.0:1788509628.709701:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796883072 00000100:00100000:2.0:1788509628.709729:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788509628.709735:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1875387796883072:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788509628.709772:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1875387796883072:12345-0@lo:900:osp-pre-1-1.0 Request processed in 36us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509628.709778:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788509628.709805:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796882944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788509628.709867:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788509628.709877:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226600/0xe5156b86310dee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dee5c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.709887:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcdb1226600/0xe5156b86310dee55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310dee5c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788509628.709950:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd913d6a00 x1875387796883072/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788509644 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509628.709974:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1875387796883072:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788509628.713174:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.713195:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.713217:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.713223:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.713232:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.713251:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.713277:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.713284:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.713316:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788509628.714089:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.714100:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.714112:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.714118:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.714129:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.714151:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.714160:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005544b944/0xe5156b86310dee63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.714185:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.714187:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.714189:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.714565:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.714573:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714586:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.714590:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.714597:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714608:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714618:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714626:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714661:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788509628.714672:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788509628.714677:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714685:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80031a00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509628.714689:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714697:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714710:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714718:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f27f59f0/0xe5156b86310dee6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.714734:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.714735:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509628.714737:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788509628.717319:0:19129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788509628.717338:0:19129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.717358:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1788509628.717371:0:19129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509628.717379:0:19129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.717394:0:19129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.717405:0:19129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.717414:0:19129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509628.717441:0:19129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788509628.717536:0:19129:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:2.0:1788509628.717617:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788509628.717626:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.717636:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030200 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509628.717647:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.717659:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.717680:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.717689:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000471d8161/0xe5156b86310dee71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509628.717710:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.717712:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509628.717714:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788509628.717856:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788509628.719223:0:18645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788509628.719616:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17169:x1875387796882432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24205us (24489us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788509628.719630:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788509628.719702:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17171:x1875387796882048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 125026us (135013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509628.719710:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509628.719772:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17171:1875387796882048:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788509628.719795:0:17171:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788509628.719857:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17171:1875387796883200:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788509628.719989:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509628.720019:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82cd4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788509628.720045:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796883200 00000100:00100000:3.0:1788509628.720052:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796883200 00000100:00100000:3.0:1788509628.720110:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788509628.720185:0:17169:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788509628.720193:0:17169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17169:1875387796882432:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788509628.720204:0:17169:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1788509628.720255:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17171:x1875387796883200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788509628.720308:0:18650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788509628.731301:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17171:x1875387796883200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11167us (11297us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788509628.731320:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788509628.731415:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17171:1875387796883200:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788509628.731437:0:17171:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1788509629.335208:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509630.359115:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509631.388797:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509631.702429:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788509631.702452:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796883328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509631.702564:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509631.702612:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796883328 00000100:00100000:0.0:1788509631.702619:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796883328 00000100:00100000:0.0:1788509631.702684:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509631.702695:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796883328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509631.702721:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509631.702766:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796883328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509631.702798:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788509631.702820:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509631.702859:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796883328:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788509632.414979:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509632.727278:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796883456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509632.727370:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509632.727475:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796883456 00000100:00100000:3.0:1788509632.727484:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796883456 00000100:00100000:3.0:1788509632.727558:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788509632.727568:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796883456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509632.727603:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788509632.727847:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796883456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 279us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509632.727857:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788509632.727923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796883456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509632.728019:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509632.728028:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796883584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509632.728059:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509632.728112:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796883584 00000100:00100000:1.0:1788509632.728117:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796883584 00000100:00100000:1.0:1788509632.728154:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788509632.728162:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796883584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788509632.728182:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788509632.728327:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796883584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509632.728346:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788509632.734319:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796883584:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788509633.442597:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509633.750702:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796883968:0@lo:400:kworker.0 00000100:00100000:0.0:1788509633.750773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.751089:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796883840:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.751124:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.751163:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796883840 00000100:00100000:2.0:1788509633.751171:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796883840 00000100:00100000:2.0:1788509633.751218:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788509633.751227:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796883840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.751293:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796883840:12345-0@lo:400:kworker.0 Request processed in 66us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.751301:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788509633.751425:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796884480:0@lo:400:kworker.0 00000100:00100000:0.0:1788509633.751454:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509633.751477:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796884096:0@lo:400:kworker.0 00000100:00100000:0.0:1788509633.751499:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509633.751585:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796883968 00000100:00100000:0.0:1788509633.751589:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796883968 00000100:00100000:0.0:1788509633.751623:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796884480 00000100:00100000:0.0:1788509633.751626:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796884480 00000100:00100000:0.0:1788509633.751644:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796884096 00000100:00100000:0.0:1788509633.751646:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796884096 00000100:00100000:0.0:1788509633.751661:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788509633.751668:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796883968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509633.751710:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796883968:12345-0@lo:400:kworker.0 Request processed in 43us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509633.751717:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788509633.751729:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788509633.751741:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796884480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509633.751768:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796884480:12345-0@lo:400:kworker.0 Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509633.751774:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788509633.751786:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788509633.751791:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796884096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752075:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796883840:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752084:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796884352:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752110:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.752132:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796884864:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752155:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.752184:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796885376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509633.752204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.752222:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788509633.752228:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796883712:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752254:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.752275:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796884224:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752296:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.752313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796884736:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752333:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.752349:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796885248:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752365:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.752423:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796884352 00000100:00100000:2.0:1788509633.752428:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796884352 00000100:00100000:2.0:1788509633.752450:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788509633.752457:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796884352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752490:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796884352:12345-0@lo:400:kworker.0 Request processed in 33us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.752504:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788509633.752536:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796884864 00000100:00100000:2.0:1788509633.752539:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796884864 00000100:00100000:2.0:1788509633.752559:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796884224 00000100:00100000:2.0:1788509633.752561:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796884224 00000100:00100000:2.0:1788509633.752572:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796884736 00000100:00100000:2.0:1788509633.752574:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796884736 00000100:00100000:2.0:1788509633.752583:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796885248 00000100:00100000:2.0:1788509633.752586:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796885248 00000100:00100000:2.0:1788509633.752598:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788509633.752604:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796884864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752636:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796884864:12345-0@lo:400:kworker.0 Request processed in 32us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.752643:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788509633.752654:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788509633.752659:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796884224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752684:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796884224:12345-0@lo:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.752691:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788509633.752701:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788509633.752707:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796884736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752732:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796884736:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.752737:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788509633.752747:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788509633.752753:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796885248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.752787:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796885248:12345-0@lo:400:kworker.0 Request processed in 34us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.752792:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788509633.753127:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875387796884096:12345-0@lo:400:kworker.0 Request processed in 1335us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509633.753135:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788509633.753155:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509633.753159:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509633.753162:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509633.753164:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509633.753192:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796884480:0@lo:400:kworker.0 00000100:00100000:0.0:1788509633.753200:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796884992:0@lo:400:kworker.0 00000100:00100000:0.0:1788509633.753227:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509633.753256:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796885504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509633.753277:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509633.753301:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796883968:0@lo:400:kworker.0 00000100:00100000:0.0:1788509633.753312:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509633.753316:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796885632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509633.753336:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509633.753355:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796885376 00000100:00100000:0.0:1788509633.753359:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796885376 00000100:00100000:0.0:1788509633.753378:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796885504 00000100:00100000:0.0:1788509633.753380:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796885504 00000100:00100000:0.0:1788509633.753407:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796885632 00000100:00100000:0.0:1788509633.753410:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796885632 00000100:00100000:0.0:1788509633.753421:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509633.753427:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796885376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509633.753449:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788509633.753478:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875387796885376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509633.753485:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788509633.753496:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509633.753501:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796885504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788509633.753523:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788509633.753549:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796885504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509633.753555:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788509633.753566:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788509633.753572:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796885632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509633.753600:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509633.753628:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796885632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509633.753635:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788509633.753649:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509633.753670:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796885632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509633.753681:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796885504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509633.753776:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796883712 00000100:00100000:2.0:1788509633.753782:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796883712 00000100:00100000:2.0:1788509633.753824:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788509633.753831:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3647:x1875387796883712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.753865:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3647:x1875387796883712:12345-0@lo:400:kworker.0 Request processed in 34us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.753872:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788509633.753914:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796884992 00000100:00100000:2.0:1788509633.753919:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796884992 00000100:00100000:2.0:1788509633.753945:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788509633.754177:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796884992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.754222:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796884992:12345-0@lo:400:kworker.0 Request processed in 49us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.754229:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788509633.754263:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796883712:0@lo:400:kworker.0 00010000:00080000:2.0:1788509633.754278:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcd87c6ad80 x1875387796884224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509633.754289:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796884224:0@lo:400:kworker.0 00010000:00080000:2.0:1788509633.754300:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787ed80 x1875387796884736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509633.754308:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796884736:0@lo:400:kworker.0 00010000:00080000:2.0:1788509633.754329:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876ac000 x1875387796885248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509633.754337:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796885248:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.754352:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796885376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788509633.754363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796884352:0@lo:400:kworker.0 00010000:00080000:2.0:1788509633.754374:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787f480 x1875387796884864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509633.754382:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796884864:0@lo:400:kworker.0 00000100:00080000:2.0:1788509633.754411:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509633.754430:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796884096:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.754436:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796884608:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.754462:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.754491:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796885120:0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.754529:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509633.754557:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796885120 00000100:00100000:2.0:1788509633.754561:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796885120 00000100:00100000:2.0:1788509633.754587:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788509633.754592:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796885120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509633.754624:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796885120:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509633.754630:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788509633.754645:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788509633.754660:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc876adc00 x1875387796885120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509633.754676:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796885120:0@lo:400:kworker.0 00000100:00100000:1.0:1788509633.754761:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796884608 00000100:00100000:1.0:1788509633.754765:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796884608 00000100:00100000:1.0:1788509633.754797:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788509633.754805:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796884608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509633.754850:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796884608:12345-0@lo:400:kworker.0 Request processed in 46us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509633.754857:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788509633.755065:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796884608:0@lo:400:kworker.0 00010000:00080000:0.0:1788509633.755144:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb787df80 x1875387796884992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788509633.755167:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796884992:0@lo:400:kworker.0 00000001:02000400:1.0:1788509633.879625:0:19820:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788509634.454441:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788509634.697610:0:19872:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788509634.697884:0:19872:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:3.0:1788509634.778971:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:3.0:1788509635.420777:0:19922:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788509635.422335:0:19922:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788509635.480035:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509635.697801:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.697991:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774782592 00000100:00100000:0.0:1788509635.698002:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774782592 00000100:00100000:0.0:1788509635.698054:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1788509635.698062:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2406:x1875387774782592:12345-192.168.203.12@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788509635.698093:0:17138:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 86ef4052-0fc2-442c-a938-e9b38a7fbf0b@192.168.203.12@tcp t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:0.0:1788509635.698120:0:17138:0:(genops.c:1385:class_connect()) connect: client 86ef4052-0fc2-442c-a938-e9b38a7fbf0b, cookie 0xe5156b86310dee78 00000100:00080000:0.0:1788509635.698260:0:17138:0:(import.c:65:import_set_state_nolock()) ffff8bcdb5c2d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509635.698335:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+5:2406:x1875387774782592:12345-192.168.203.12@tcp:250:mount.lustre.0 Request processed in 271us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509635.698344:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:3.0:1788509635.706425:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.706538:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774782720 00000100:00100000:0.0:1788509635.706548:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774782720 00000100:00100000:0.0:1788509635.706615:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1788509635.706626:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+5:14897:x1875387774782720:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788509635.706641:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509635.706659:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc8846fa00/0xe5156b86310dee7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647553446 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509635.706837:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846fa00/0xe5156b86310dee7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553446 expref: 6 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509635.706851:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc8846fa00/0xe5156b86310dee7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553446 expref: 6 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509635.706861:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846fa00, rc 0) 00000100:00100000:0.0:1788509635.707651:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+6:14897:x1875387774782720:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 1021us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509635.707660:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1788509635.711892:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509635.712103:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774782848 00000100:00100000:2.0:1788509635.712114:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774782848 00000100:00100000:2.0:1788509635.712172:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1788509635.712182:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd827f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+6:14897:x1875387774782848:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788509635.712301:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd827f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+6:14897:x1875387774782848:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 120us (417us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509635.712309:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1788509635.716056:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509635.717793:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774782976 00000100:00100000:1.0:1788509635.717806:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774782976 00000100:00100000:1.0:1788509635.718013:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1788509635.718024:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+6:14897:x1875387774782976:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788509635.718039:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509635.718055:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dee86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e464755344d expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509635.718083:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dee86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755344d expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509635.718095:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862ae200/0xe5156b86310dee86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755344d expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509635.718103:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae200, rc 0) 00000100:00100000:1.0:1788509635.718179:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+7:14897:x1875387774782976:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 157us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509635.718186:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:3.0:1788509635.723112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.723802:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774783104 00000100:00100000:0.0:1788509635.723813:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774783104 00000100:00100000:0.0:1788509635.723879:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1788509635.723890:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+7:14897:x1875387774783104:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788509635.724133:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14897:x1875387774783104:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 244us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509635.724141:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1788509635.730562:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509635.730667:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774783232 00000100:00100000:1.0:1788509635.730677:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774783232 00000100:00100000:1.0:1788509635.730735:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1788509635.730745:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14897:x1875387774783232:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788509635.730892:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14897:x1875387774783232:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 148us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509635.730936:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:3.0:1788509635.747966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509635.748118:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774783360 00000100:00100000:2.0:1788509635.748139:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774783360 00000100:00100000:2.0:1788509635.748199:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:2.0:1788509635.748209:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14916:x1875387774783360:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788509635.748366:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14916:x1875387774783360:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 159us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509635.748375:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1788509635.784513:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.784740:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774783488 00000100:00100000:0.0:1788509635.784755:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774783488 00000100:00100000:0.0:1788509635.784826:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:0.0:1788509635.784838:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14916:x1875387774783488:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788509635.785101:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14916:x1875387774783488:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 264us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509635.785111:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:3.0:1788509635.795356:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509635.797081:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774783616 00000100:00100000:1.0:1788509635.797100:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774783616 00000100:00100000:1.0:1788509635.797233:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788509635.797246:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14916:x1875387774783616:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788509635.797482:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14916:x1875387774783616:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 238us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509635.797505:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1788509635.800137:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.801640:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774783744 00000100:00100000:0.0:1788509635.801659:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774783744 00000100:00100000:0.0:1788509635.801735:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1788509635.801748:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+8:14897:x1875387774783744:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788509635.801770:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509635.802026:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc8846ee00/0xe5156b86310dee8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e464755347e expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509635.802068:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846ee00/0xe5156b86310dee8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755347e expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509635.802099:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc8846ee00/0xe5156b86310dee8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755347e expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509635.802111:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846ee00, rc 0) 00000100:00100000:0.0:1788509635.802263:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+9:14897:x1875387774783744:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 517us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509635.802271:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1788509635.806084:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.806261:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774783872 00000100:00100000:0.0:1788509635.806280:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774783872 00000100:00100000:0.0:1788509635.806519:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:0.0:1788509635.806533:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+9:14897:x1875387774783872:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788509635.806570:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788509635.806608:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788509635.806613:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788509635.806616:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788509635.806619:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788509635.806622:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788509635.811667:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+9:14897:x1875387774783872:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 5127us (5582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509635.811682:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:3.0:1788509635.822757:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509635.823057:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774784000 00000100:00100000:2.0:1788509635.823067:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774784000 00000100:00100000:2.0:1788509635.823123:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1788509635.823146:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+9:14897:x1875387774784000:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788509635.823163:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509635.823180:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647553485 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509635.823208:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509635.823219:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509635.823229:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227200, rc 0) 00000100:00100000:2.0:1788509635.823288:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14897:x1875387774784000:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 143us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509635.823295:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:3.0:1788509635.826080:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509635.826348:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774784128 00000100:00100000:2.0:1788509635.826357:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774784128 00000100:00100000:2.0:1788509635.826424:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:2.0:1788509635.826433:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14897:x1875387774784128:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788509635.826589:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14897:x1875387774784128:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 155us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509635.826597:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:0.0:1788509635.830710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509635.830815:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774784256 00000100:00100000:1.0:1788509635.830834:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774784256 00000100:00100000:1.0:1788509635.830953:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:1.0:1788509635.830966:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14897:x1875387774784256:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788509635.831169:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14897:x1875387774784256:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 205us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509635.831177:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:3.0:1788509635.834227:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509635.834611:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774784384 00000100:00100000:2.0:1788509635.834622:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774784384 00000100:00100000:2.0:1788509635.834684:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:2.0:1788509635.834694:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14923:x1875387774784384:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788509635.834974:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14923:x1875387774784384:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 281us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509635.834990:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:3.0:1788509635.841315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.841428:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774784512 00000100:00100000:0.0:1788509635.841439:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774784512 00000100:00100000:0.0:1788509635.841510:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1788509635.841520:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14923:x1875387774784512:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788509635.841724:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:14923:x1875387774784512:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 204us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509635.841732:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1788509635.848376:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.848501:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509635.848598:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774784640 00000100:00100000:1.0:1788509635.848613:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774784640 00000100:00100000:2.0:1788509635.848618:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774784896 00000100:00100000:2.0:1788509635.848622:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774784896 00000100:00100000:2.0:1788509635.848660:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788509635.848668:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875387774784640:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788509635.848698:0:17146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ef7b9534-bb6d-4d0d-98ea-73f5051501ca@192.168.203.12@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1788509635.848748:0:17146:0:(genops.c:1385:class_connect()) connect: client ef7b9534-bb6d-4d0d-98ea-73f5051501ca, cookie 0xe5156b86310dee9b 00000004:00100000:2.0:1788509635.848777:0:17146:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788509635.849006:0:17146:0:(import.c:65:import_set_state_nolock()) ffff8bcc860ce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509635.849079:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2406:x1875387774784640:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 410us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509635.852124:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.852160:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509635.852229:0:17144:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788509635.852240:0:17144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788509635.852698:0:17145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788509635.852710:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774785152 00000100:00100000:1.0:1788509635.852719:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774785152 00000100:00100000:1.0:1788509635.852775:0:17145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788509635.852781:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774784768 00000100:00100000:1.0:1788509635.852783:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774784768 00000100:00080000:3.0:1788509635.852845:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509635.853180:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788509635.853188:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1875387774784896:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788509635.853218:0:19934:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ef7b9534-bb6d-4d0d-98ea-73f5051501ca@192.168.203.12@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788509635.853266:0:19934:0:(genops.c:1385:class_connect()) connect: client ef7b9534-bb6d-4d0d-98ea-73f5051501ca, cookie 0xe5156b86310deea2 00000004:00100000:3.0:1788509635.853293:0:19934:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788509635.853530:0:19934:0:(import.c:65:import_set_state_nolock()) ffff8bcc87581800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788509635.853606:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2406:x1875387774784896:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 416us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509635.853615:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788509635.853638:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788509635.853654:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+8:14897:x1875387774785152:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788509635.853680:0:19934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788509635.853726:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+8:14897:x1875387774785152:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 73us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509635.853733:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788509635.853749:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788509635.853756:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:0:x1875387774784768:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788509635.853767:0:19934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788509635.853789:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:0:x1875387774784768:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 34us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509635.853795:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788509635.854618:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788509635.861375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509635.861428:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509635.861575:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774785280 00000100:00100000:1.0:1788509635.861585:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774785280 00000100:00100000:1.0:1788509635.861641:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774785024 00000100:00100000:1.0:1788509635.861644:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774785024 00000100:00100000:1.0:1788509635.861687:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788509635.861696:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14897:x1875387774785280:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788509635.861775:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14897:x1875387774785280:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509635.861782:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:2.0:1788509635.861789:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509635.861800:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788509635.861807:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:0:x1875387774785024:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788509635.861839:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788509635.861945:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:0:x1875387774785024:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 138us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509635.861951:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788509635.864369:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.864472:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509635.864557:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509635.867870:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774785408 00000100:00100000:1.0:1788509635.867888:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774785408 00000100:00100000:1.0:1788509635.867974:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774785536 00000100:00100000:1.0:1788509635.867978:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774785536 00000100:00100000:1.0:1788509635.868004:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788509635.868013:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875387774785408:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788509635.868048:0:18650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ef7b9534-bb6d-4d0d-98ea-73f5051501ca@192.168.203.12@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1788509635.868096:0:18650:0:(genops.c:1385:class_connect()) connect: client ef7b9534-bb6d-4d0d-98ea-73f5051501ca, cookie 0xe5156b86310deea9 00002000:00100000:1.0:1788509635.868108:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ef7b9534-bb6d-4d0d-98ea-73f5051501ca/ffff8bcd97c03800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788509635.868126:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788509635.868311:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774785664 00000100:00100000:2.0:1788509635.868317:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774785664 00002000:00080000:1.0:1788509635.868346:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788509635.868352:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788509635.868358:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14897:x1875387774785664:12345-192.168.203.12@tcp:900:mount.lustre.0 00000100:00080000:1.0:1788509635.868379:0:18650:0:(import.c:65:import_set_state_nolock()) ffff8bcd97c06800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509635.868435:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14897:x1875387774785664:12345-192.168.203.12@tcp:900:mount.lustre.0 Request processed in 75us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509635.868443:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788509635.868453:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1788509635.868458:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1875387774785536:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788509635.868476:0:18648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ef7b9534-bb6d-4d0d-98ea-73f5051501ca@192.168.203.12@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788509635.868518:0:18648:0:(genops.c:1385:class_connect()) connect: client ef7b9534-bb6d-4d0d-98ea-73f5051501ca, cookie 0xe5156b86310deeb0 00002000:00100000:3.0:1788509635.868524:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ef7b9534-bb6d-4d0d-98ea-73f5051501ca/ffff8bcdb7e86000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788509635.868536:0:18648:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788509635.868656:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788509635.868673:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8bcdb7e85000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788509635.868713:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2406:x1875387774785408:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 699us (4240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509635.868721:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788509635.870964:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509635.871390:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774785792 00000100:00100000:1.0:1788509635.871411:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774785792 00000100:00100000:1.0:1788509635.871470:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788509635.871481:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14897:x1875387774785792:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788509635.872097:0:17147:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 525us 00000100:00100000:2.0:1788509635.872543:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2406:x1875387774785536:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 2353us (6256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509635.872558:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000004:00200000:2.0:1788509635.888164:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788509635.888289:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14897:x1875387774785792:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 16805us (17321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509635.888312:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000040:00080000:2.0:1788509635.926794:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788509636.062371:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509636.062516:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774785920 00000100:00100000:1.0:1788509636.062590:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774785920 00000100:00100000:1.0:1788509636.062790:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788509636.062803:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14946:x1875387774785920:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:1.0:1788509636.062834:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509636.062862:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310deeb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475534b6 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509636.062961:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310deebe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509636.062976:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310deebe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509636.063008:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310deebe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509636.063058:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788509636.063062:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509636.063104:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310deebe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509636.063132:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862af600/0xe5156b86310deeb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534b6 expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509636.063150:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310deebe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534b6 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509636.063158:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc8761cc00) 00010000:00010000:1.0:1788509636.063160:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788509636.063163:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862ae000, rc 0) 00000100:00100000:1.0:1788509636.063275:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:14946:x1875387774785920:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 474us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509636.063282:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:3.0:1788509636.502191:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788509636.822136:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc876adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796885760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509636.822200:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509636.822286:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796885760 00000100:00100000:0.0:1788509636.822294:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796885760 00000100:00100000:0.0:1788509636.822358:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509636.822366:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796885760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509636.822387:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509636.822425:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796885760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509636.822432:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788509636.822519:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc876adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796885760:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788509636.822581:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788509637.526207:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509637.847220:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796885888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509637.847311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509637.847858:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796885888 00000100:00100000:3.0:1788509637.847867:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796885888 00000100:00100000:3.0:1788509637.847948:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788509637.847958:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796885888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509637.847990:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788509637.848056:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796885888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509637.848063:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788509637.848243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796885888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788509637.848377:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796886016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788509637.848416:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509637.848560:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796886016 00000100:00100000:2.0:1788509637.848566:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796886016 00000100:00100000:3.0:1788509637.848619:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788509637.848633:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796886016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788509637.848653:0:17886:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788509637.854091:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796886016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5450us (5665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509637.854108:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788509637.854297:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796886016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788509638.234304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509638.236610:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774786048 00000100:00100000:0.0:1788509638.236625:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774786048 00000100:00100000:0.0:1788509638.236716:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1788509638.236727:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:14999:x1875387774786048:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1788509638.236765:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788509638.236856:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:14999:x1875387774786048:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 131us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.236879:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00080000:2.0:1788509638.239426:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509638.245648:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.245754:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774786176 00000100:00100000:2.0:1788509638.245764:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774786176 00000100:00100000:2.0:1788509638.245835:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788509638.245845:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14999:x1875387774786176:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1788509638.245874:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788509638.245989:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14999:x1875387774786176:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 145us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.245997:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00080000:3.0:1788509638.250638:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509638.264495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.264620:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774786304 00000100:00100000:2.0:1788509638.264629:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774786304 00000100:00100000:2.0:1788509638.264753:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788509638.264763:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14999:x1875387774786304:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:2.0:1788509638.264792:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788509638.264934:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14999:x1875387774786304:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 173us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.264942:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00080000:3.0:1788509638.264991:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509638.270125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509638.270267:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774786432 00000100:00100000:1.0:1788509638.270276:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774786432 00000100:00100000:1.0:1788509638.270346:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788509638.270367:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14999:x1875387774786432:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1788509638.270409:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788509638.270495:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:14999:x1875387774786432:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 129us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.270502:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:3.0:1788509638.272283:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788509638.458768:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509638.460851:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774786560 00000100:00100000:1.0:1788509638.460864:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774786560 00000100:00100000:1.0:1788509638.460955:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:1.0:1788509638.460966:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+10:15028:x1875387774786560:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788509638.460982:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509638.461000:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862af200/0xe5156b86310deec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e46475534bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509638.461031:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862af200/0xe5156b86310deec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534bd expref: 11 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509638.461042:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862af200/0xe5156b86310deec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534bd expref: 11 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509638.461052:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af200, rc 0) 00000100:00100000:1.0:1788509638.461122:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15028:x1875387774786560:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 157us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.461129:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:0.0:1788509638.464666:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.465401:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774786688 00000100:00100000:2.0:1788509638.465412:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774786688 00000100:00100000:2.0:1788509638.465495:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1788509638.465505:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15028:x1875387774786688:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788509638.465675:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd6f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15028:x1875387774786688:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 171us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.465683:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1788509638.469127:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509638.469750:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774786816 00000100:00100000:0.0:1788509638.469760:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774786816 00000100:00100000:0.0:1788509638.469867:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1788509638.469877:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15028:x1875387774786816:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788509638.470056:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15028:x1875387774786816:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 180us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.470064:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:3.0:1788509638.486053:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509638.486163:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774786944 00000100:00100000:1.0:1788509638.486172:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774786944 00000100:00100000:1.0:1788509638.486227:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:1.0:1788509638.486237:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15036:x1875387774786944:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788509638.486423:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15036:x1875387774786944:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 186us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.486431:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:0.0:1788509638.542271:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.542368:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774787072 00000100:00100000:2.0:1788509638.542379:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774787072 00000100:00100000:2.0:1788509638.542439:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:2.0:1788509638.542449:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15036:x1875387774787072:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788509638.542618:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15036:x1875387774787072:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 171us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.542626:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00010000:00010000:3.0:1788509638.551261:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509638.590057:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.590189:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774787200 00000100:00100000:2.0:1788509638.590199:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774787200 00000100:00100000:2.0:1788509638.590262:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:2.0:1788509638.590271:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15036:x1875387774787200:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788509638.590425:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15036:x1875387774787200:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 154us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.590432:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:0.0:1788509638.602584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509638.602721:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774787328 00000100:00100000:1.0:1788509638.602730:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774787328 00000100:00100000:1.0:1788509638.602785:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:1.0:1788509638.602805:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:15028:x1875387774787328:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788509638.602822:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509638.602839:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc862af000/0xe5156b86310deecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e46475534ee expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509638.602866:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862af000/0xe5156b86310deecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534ee expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509638.602877:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc862af000/0xe5156b86310deecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534ee expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509638.602886:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc862af000, rc 0) 00000100:00100000:1.0:1788509638.602967:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:15028:x1875387774787328:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 164us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.602983:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:3.0:1788509638.609975:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509638.610066:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774787456 00000100:00100000:0.0:1788509638.610076:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774787456 00000100:00100000:0.0:1788509638.610140:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:0.0:1788509638.610151:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:15028:x1875387774787456:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788509638.610175:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788509638.610198:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788509638.610202:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788509638.610204:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788509638.610207:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788509638.610210:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788509638.612156:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:15028:x1875387774787456:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 1999us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.612167:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788509638.619894:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.623064:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774787584 00000100:00100000:2.0:1788509638.623077:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774787584 00000100:00100000:2.0:1788509638.623218:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:2.0:1788509638.623229:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:15028:x1875387774787584:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788509638.623247:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509638.623277:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e46475534f5 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509638.623308:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509638.623319:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509638.623328:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226e00, rc 0) 00000100:00100000:2.0:1788509638.623403:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15028:x1875387774787584:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 175us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.623410:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:3.0:1788509638.630656:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509638.630720:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774787712 00000100:00100000:0.0:1788509638.630730:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774787712 00000100:00100000:0.0:1788509638.630794:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:0.0:1788509638.630803:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15028:x1875387774787712:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788509638.630991:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15028:x1875387774787712:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 188us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.630999:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:3.0:1788509638.633155:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509638.633240:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774787840 00000100:00100000:0.0:1788509638.633249:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774787840 00000100:00100000:0.0:1788509638.633299:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:0.0:1788509638.633308:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15028:x1875387774787840:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788509638.633648:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15028:x1875387774787840:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 139us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.633656:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:3.0:1788509638.642458:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.642981:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774787968 00000100:00100000:2.0:1788509638.642992:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774787968 00000100:00100000:2.0:1788509638.643049:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:2.0:1788509638.643058:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15042:x1875387774787968:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788509638.643202:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15042:x1875387774787968:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 144us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.643209:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:3.0:1788509638.649871:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509638.659791:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774788096 00000100:00100000:1.0:1788509638.659806:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774788096 00000100:00100000:1.0:1788509638.660120:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:1.0:1788509638.660131:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15042:x1875387774788096:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788509638.660295:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:15042:x1875387774788096:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 166us (10434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.660318:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:3.0:1788509638.669983:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509638.670052:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509638.670141:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774788224 00000100:00100000:0.0:1788509638.670151:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774788224 00000100:00100000:0.0:1788509638.670194:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774788480 00000100:00100000:0.0:1788509638.670197:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774788480 00000100:00100000:0.0:1788509638.670218:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788509638.670227:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875387774788224:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788509638.670257:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 969fd51c-5e49-4545-9833-40161db51328@192.168.203.12@tcp t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:0.0:1788509638.670298:0:17144:0:(genops.c:1385:class_connect()) connect: client 969fd51c-5e49-4545-9833-40161db51328, cookie 0xe5156b86310deeda 00000004:00100000:0.0:1788509638.670335:0:17144:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788509638.670430:0:17144:0:(import.c:65:import_set_state_nolock()) ffff8bcdb5c29800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509638.670504:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:969fd51c-5e49-4545-9833-40161db51328+6:2406:x1875387774788224:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 276us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.670527:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788509638.670545:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788509638.670549:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875387774788480:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788509638.670566:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 969fd51c-5e49-4545-9833-40161db51328@192.168.203.12@tcp t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:0.0:1788509638.670588:0:17144:0:(genops.c:1385:class_connect()) connect: client 969fd51c-5e49-4545-9833-40161db51328, cookie 0xe5156b86310deee1 00000004:00100000:0.0:1788509638.670599:0:17144:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788509638.670640:0:17144:0:(import.c:65:import_set_state_nolock()) ffff8bcdb5c2d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788509638.670675:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:969fd51c-5e49-4545-9833-40161db51328+6:2406:x1875387774788480:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 123us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.670681:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000040:00080000:0.0:1788509638.678606:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788509638.681274:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509638.681319:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509638.681380:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774788608 00000100:00100000:1.0:1788509638.681390:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774788608 00000100:00100000:1.0:1788509638.681467:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774788352 00000100:00100000:1.0:1788509638.681482:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774788352 00000100:00100000:1.0:1788509638.681517:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788509638.681526:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc876ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:969fd51c-5e49-4545-9833-40161db51328+6:0:x1875387774788608:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788509638.681554:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:2.0:1788509638.681641:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509638.681645:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509638.681825:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc876ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:969fd51c-5e49-4545-9833-40161db51328+6:0:x1875387774788608:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 299us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.681834:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788509638.681855:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788509638.681866:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+6:0:x1875387774788352:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788509638.682024:0:19934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788509638.691966:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+6:0:x1875387774788352:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 10090us (10634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.691980:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788509638.693213:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509638.696954:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774788736 00000100:00100000:0.0:1788509638.696969:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774788736 00000100:00100000:0.0:1788509638.697050:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788509638.697061:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:969fd51c-5e49-4545-9833-40161db51328+6:15028:x1875387774788736:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788509638.697093:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788509638.697175:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:969fd51c-5e49-4545-9833-40161db51328+6:15028:x1875387774788736:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 115us (3967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.697183:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788509638.707611:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509638.707858:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774788864 00000100:00100000:3.0:1788509638.707869:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774788864 00000100:00100000:3.0:1788509638.707935:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788509638.707944:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+6:15028:x1875387774788864:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788509638.708030:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+6:15028:x1875387774788864:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 87us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.708038:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788509638.714879:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.715063:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774789248 00000100:00100000:2.0:1788509638.715073:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774789248 00000100:00100000:2.0:1788509638.715128:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788509638.715137:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:969fd51c-5e49-4545-9833-40161db51328+6:15028:x1875387774789248:12345-192.168.203.12@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788509638.715204:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:969fd51c-5e49-4545-9833-40161db51328+6:15028:x1875387774789248:12345-192.168.203.12@tcp:900:mount.lustre.0 Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.715224:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788509638.719003:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509638.719041:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509638.719360:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774788992 00000100:00100000:1.0:1788509638.719369:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774788992 00000100:00100000:1.0:1788509638.719433:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774789120 00000100:00100000:1.0:1788509638.719438:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774789120 00000100:00100000:2.0:1788509638.719439:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788509638.719448:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875387774788992:12345-192.168.203.12@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788509638.719465:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788509638.719484:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875387774789120:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788509638.719497:0:19129:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 969fd51c-5e49-4545-9833-40161db51328@192.168.203.12@tcp t0 exp 0000000000000000 cur 535 last 0 00010000:00080000:1.0:1788509638.719498:0:18650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 969fd51c-5e49-4545-9833-40161db51328@192.168.203.12@tcp t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:2.0:1788509638.719576:0:19129:0:(genops.c:1385:class_connect()) connect: client 969fd51c-5e49-4545-9833-40161db51328, cookie 0xe5156b86310deee8 00000020:00000080:1.0:1788509638.719576:0:18650:0:(genops.c:1385:class_connect()) connect: client 969fd51c-5e49-4545-9833-40161db51328, cookie 0xe5156b86310deeef 00002000:00100000:2.0:1788509638.719587:0:19129:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 969fd51c-5e49-4545-9833-40161db51328/ffff8bcc863da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788509638.719591:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 969fd51c-5e49-4545-9833-40161db51328/ffff8bcd97c04000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788509638.719596:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:2.0:1788509638.719597:0:19129:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788509638.719667:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:2.0:1788509638.719668:0:19129:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788509638.719705:0:18650:0:(import.c:65:import_set_state_nolock()) ffff8bcd97c03000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788509638.719760:0:19129:0:(import.c:65:import_set_state_nolock()) ffff8bcc863da000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788509638.719784:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:969fd51c-5e49-4545-9833-40161db51328+6:2406:x1875387774788992:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 335us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.719784:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:969fd51c-5e49-4545-9833-40161db51328+6:2406:x1875387774789120:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 311us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509638.719792:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788509638.719806:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788509638.725329:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509638.725509:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774789376 00000100:00100000:3.0:1788509638.725519:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774789376 00000100:00100000:3.0:1788509638.725574:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788509638.725584:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:969fd51c-5e49-4545-9833-40161db51328+6:15028:x1875387774789376:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788509638.725679:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788509638.725761:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:969fd51c-5e49-4545-9833-40161db51328+6:15028:x1875387774789376:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 178us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.725768:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788509638.871108:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788509638.871131:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796886144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788509638.871223:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509638.871290:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796886144 00000100:00100000:0.0:1788509638.871299:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796886144 00000100:00100000:0.0:1788509638.871354:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788509638.871362:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796886144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509638.871383:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509638.871426:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796886144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.871433:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788509638.871590:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509638.873132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796886272:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873198:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.873235:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796886784:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873275:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.873298:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796887296:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873319:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.873341:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788509638.873346:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796886400:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873380:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.873396:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796886912:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873415:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.873431:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796887424:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873448:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.873503:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796886784 00000100:00100000:3.0:1788509638.873509:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796886784 00000100:00100000:3.0:1788509638.873546:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796886400 00000100:00100000:3.0:1788509638.873549:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796886400 00000100:00100000:3.0:1788509638.873563:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788509638.873570:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796886784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873630:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796886784:12345-0@lo:400:kworker.0 Request processed in 59us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.873637:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788509638.873654:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788509638.873660:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796886400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873684:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796886400:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.873689:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788509638.873707:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796886912 00000100:00100000:3.0:1788509638.873710:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796886912 00000100:00100000:3.0:1788509638.873741:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788509638.873748:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796886912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.873776:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796886912:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.873781:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788509638.873812:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796887296 00000100:00100000:3.0:1788509638.873816:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796887296 00000100:00100000:3.0:1788509638.873841:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796887424 00000100:00100000:3.0:1788509638.873844:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796887424 00000100:00100000:3.0:1788509638.873959:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788509638.873967:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796887296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874000:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875387796887296:12345-0@lo:400:kworker.0 Request processed in 34us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.874006:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788509638.874017:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788509638.874022:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796887424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874222:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875387796887424:12345-0@lo:400:kworker.0 Request processed in 193us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.874229:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788509638.874272:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796886400:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874284:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796886912:0@lo:400:kworker.0 00010000:00080000:3.0:1788509638.874296:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb789aa00 x1875387796887424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509638.874305:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875387796887424:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874315:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796886784:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874325:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875387796887296:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874368:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796886272 00000100:00100000:3.0:1788509638.874371:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796886272 00000100:00100000:3.0:1788509638.874402:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788509638.874409:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3646:x1875387796886272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874453:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3646:x1875387796886272:12345-0@lo:400:kworker.0 Request processed in 44us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.874460:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788509638.874504:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796886272:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874576:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796887808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509638.874602:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.874636:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796887808 00000100:00100000:3.0:1788509638.874640:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796887808 00000100:00100000:3.0:1788509638.874678:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788509638.874685:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796887808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788509638.874699:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788509638.874735:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796887808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.874741:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788509638.874769:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796887808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509638.874808:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796886528:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.874832:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.874851:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796887040:0@lo:400:kworker.0 00000100:00080000:1.0:1788509638.875010:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788509638.875016:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509638.875018:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509638.875020:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509638.875031:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796886656:0@lo:400:kworker.0 00000100:00100000:1.0:1788509638.875060:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.875173:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.875226:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796887552:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.875254:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509638.875284:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796886144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509638.875309:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796886656 00000100:00100000:3.0:1788509638.875321:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796886656 00000100:00100000:3.0:1788509638.875346:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796887552 00000100:00100000:3.0:1788509638.875348:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796887552 00000100:00100000:3.0:1788509638.875372:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788509638.875377:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796886656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.875408:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875387796886656:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.875414:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788509638.875425:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788509638.875432:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796887552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.875461:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875387796887552:12345-0@lo:400:kworker.0 Request processed in 31us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.875467:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788509638.875506:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875387796887552:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.875549:0:19531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796886528 00000100:00100000:3.0:1788509638.875552:0:19531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796886528 00000100:00100000:3.0:1788509638.875573:0:19531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796887040 00000100:00100000:3.0:1788509638.875576:0:19531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796887040 00000100:00100000:3.0:1788509638.875590:0:19531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788509638.875596:0:19531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796886528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.875629:0:19531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796886528:12345-0@lo:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.875635:0:19531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788509638.875645:0:19531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788509638.875651:0:19531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796887040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.875674:0:19531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796887040:12345-0@lo:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509638.875688:0:19531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788509638.875714:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788509638.875725:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796886528:0@lo:400:kworker.0 00000100:00100000:3.0:1788509638.875735:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796887040:0@lo:400:kworker.0 00000100:00080000:3.0:1788509638.875762:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509638.875765:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509638.875842:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875387796886656:0@lo:400:kworker.0 00000100:00100000:1.0:1788509638.875851:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796887168:0@lo:400:kworker.0 00000100:00100000:0.0:1788509638.875853:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788509638.875862:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796887936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509638.875893:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509638.875893:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509638.875939:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796887168 00000100:00100000:1.0:1788509638.875943:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796887168 00000100:00100000:1.0:1788509638.875973:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788509638.875979:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796887168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509638.876010:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796887168:12345-0@lo:400:kworker.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.876015:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788509638.876040:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796887168:0@lo:400:kworker.0 00000100:00100000:0.0:1788509638.876045:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796887936 00000100:00100000:1.0:1788509638.876046:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796887680:0@lo:400:kworker.0 00000100:00100000:0.0:1788509638.876048:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796887936 00000100:00100000:1.0:1788509638.876071:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509638.876081:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788509638.876088:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796887936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509638.876099:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788509638.876102:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796887680 00000100:00100000:1.0:1788509638.876105:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796887680 00000100:00100000:0.0:1788509638.876132:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796887936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509638.876144:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788509638.876176:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796887936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509638.876339:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788509638.876346:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796887680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509638.876390:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796887680:12345-0@lo:400:kworker.0 Request processed in 46us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509638.876403:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788509638.876445:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7899500 x1875387796887680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509638.876457:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796887680:0@lo:400:kworker.0 00000100:00080000:3.0:1788509638.876468:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788509639.016348:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509639.016490:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774789504 00000100:00100000:2.0:1788509639.016506:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774789504 00000100:00100000:2.0:1788509639.016594:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788509639.016606:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:969fd51c-5e49-4545-9833-40161db51328+6:15064:x1875387774789504:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:2.0:1788509639.016632:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509639.016661:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310deef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553526 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509639.016749:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509639.016766:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509639.016781:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509639.016828:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788509639.016833:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509639.016864:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509639.016891:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310deef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509639.016937:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509639.016948:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc8761cc00) 00010000:00010000:2.0:1788509639.016951:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788509639.016954:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227a00, rc 0) 00000100:00100000:2.0:1788509639.017026:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:969fd51c-5e49-4545-9833-40161db51328+7:15064:x1875387774789504:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 423us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509639.017033:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00010000:00010000:1.0:1788509639.574332:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788509640.598243:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788509641.624166:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509641.948255:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509641.948285:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796888064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788509641.948593:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509641.948654:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796888064 00000100:00100000:0.0:1788509641.948665:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796888064 00000100:00100000:0.0:1788509641.948736:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788509641.948747:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796888064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509641.949438:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509641.949542:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796888064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 794us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509641.949552:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788509641.949608:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509641.949736:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796888064:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788509641.953209:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 969fd51c-5e49-4545-9833-40161db51328 00000001:00100000:1.0:1788509641.953276:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ef7b9534-bb6d-4d0d-98ea-73f5051501ca 00000001:00100000:0.0:1788509641.959136:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 969fd51c-5e49-4545-9833-40161db51328 00000001:00100000:0.0:1788509641.959153:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef7b9534-bb6d-4d0d-98ea-73f5051501ca 00000001:00100000:1.0:1788509641.963070:0:18645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 969fd51c-5e49-4545-9833-40161db51328 00000001:00100000:1.0:1788509641.963089:0:18645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ef7b9534-bb6d-4d0d-98ea-73f5051501ca 00000001:00100000:1.0:1788509641.963765:0:17124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 969fd51c-5e49-4545-9833-40161db51328 00000001:00100000:1.0:1788509641.963776:0:17124:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ef7b9534-bb6d-4d0d-98ea-73f5051501ca 00000001:02000400:1.0:1788509642.317215:0:20021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788509642.652180:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509642.967025:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509642.967054:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796888192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509642.967152:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509642.967257:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796888192 00000100:00100000:3.0:1788509642.967504:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796888192 00000100:00100000:2.0:1788509642.967645:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788509642.967657:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796888192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788509642.967718:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788509642.967788:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796888192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509642.967797:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788509642.967853:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796888192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509642.970395:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788509642.970428:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796888320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509642.970530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509642.971388:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796888320 00000100:00100000:2.0:1788509642.971401:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796888320 00000100:00100000:2.0:1788509642.971496:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788509642.971508:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796888320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509642.971558:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788509642.971640:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796888320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509642.971648:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788509642.972038:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796888320:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788509643.676070:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509643.990654:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796888448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509643.990746:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509643.991013:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796888448 00000100:00100000:3.0:1788509643.991024:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796888448 00000100:00100000:3.0:1788509643.991103:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788509643.991118:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796888448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788509643.991158:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788509643.991217:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796888448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509643.991239:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788509643.991934:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:830aae98-6419-4d90-97fb-7d4af2af47a0:3644:1875387796888576:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.991986:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509643.992017:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796889088:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509643.992063:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796889600:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992089:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509643.992107:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796890112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509643.992129:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509643.992147:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788509643.992153:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796888704:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992176:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509643.992203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796889216:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992234:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509643.992267:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796889728:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992288:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509643.992321:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796889088 00000100:00100000:2.0:1788509643.992327:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796889088 00000100:00100000:2.0:1788509643.992366:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796888704 00000100:00100000:2.0:1788509643.992369:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796888704 00000100:00100000:2.0:1788509643.992384:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788509643.992392:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796889088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992454:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796889088:12345-0@lo:400:kworker.0 Request processed in 62us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.992461:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788509643.992482:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788509643.992488:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796888704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992514:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796888704:12345-0@lo:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.992519:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788509643.992538:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796889600 00000100:00100000:2.0:1788509643.992541:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796889600 00000100:00100000:2.0:1788509643.992568:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796889728 00000100:00100000:2.0:1788509643.992571:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796889728 00000100:00100000:2.0:1788509643.992589:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788509643.992595:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796889600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992625:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796889600:12345-0@lo:400:kworker.0 Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.992631:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788509643.992651:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788509643.992657:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796889728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992684:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875387796889728:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.992690:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788509643.992713:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796889216 00000100:00100000:2.0:1788509643.992716:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796889216 00000100:00100000:2.0:1788509643.992748:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509643.992755:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796889216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992797:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796889216:12345-0@lo:400:kworker.0 Request processed in 43us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.992804:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788509643.992861:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796888704:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992874:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796889216:0@lo:400:kworker.0 00010000:00080000:2.0:1788509643.992888:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87354e00 x1875387796889728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509643.992923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875387796889728:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992935:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796889088:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.992944:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796889600:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.993061:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796890112 00000100:00100000:2.0:1788509643.993065:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796890112 00000100:00100000:3.0:1788509643.993374:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796888832:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.993414:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509643.993449:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796889344:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.993471:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509643.993487:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796889856:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.993505:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509643.993522:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788509643.993527:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796888960:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.993546:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509643.993558:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796889472:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.993576:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509643.993588:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796889984:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.993610:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509643.993632:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796888832 00000100:00100000:3.0:1788509643.993636:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796888832 00000100:00100000:3.0:1788509643.993662:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796889344 00000100:00100000:3.0:1788509643.993664:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796889344 00000100:00100000:3.0:1788509643.993680:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509643.993687:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796888832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.993728:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796888832:12345-0@lo:400:kworker.0 Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509643.993734:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788509643.993750:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509643.993755:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796889344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.995554:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875387796889344:12345-0@lo:400:kworker.0 Request processed in 1787us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509643.995570:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509643.995645:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796888832:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.995656:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796889344:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.995716:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796888448:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788509643.995793:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788509643.995800:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509643.995804:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788509643.995807:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509643.995824:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796889856 00000100:00100000:3.0:1788509643.995831:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796889856 00000100:00100000:3.0:1788509643.995874:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796888960 00000100:00100000:3.0:1788509643.995877:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796888960 00000100:00100000:3.0:1788509643.995888:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796889472 00000100:00100000:3.0:1788509643.995890:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796889472 00000100:00100000:2.0:1788509643.997865:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796889984 00000100:00100000:2.0:1788509643.997879:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796889984 00000100:00100000:3.0:1788509643.998069:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788509643.998084:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796889856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.998203:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875387796889856:12345-0@lo:400:kworker.0 Request processed in 124us (4695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509643.998211:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788509643.998253:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788509643.998262:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796888960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.998312:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875387796888960:12345-0@lo:400:kworker.0 Request processed in 52us (4766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.998319:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788509643.998333:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788509643.998339:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd913e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796889472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.998370:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd913e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875387796889472:12345-0@lo:400:kworker.0 Request processed in 31us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.998376:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788509643.998386:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788509643.998392:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796889984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.998420:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875387796889984:12345-0@lo:400:kworker.0 Request processed in 29us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.998426:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788509643.998467:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509643.998475:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796890112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788509643.998502:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788509643.998546:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796890112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.998552:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788509643.998605:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796890112:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788509643.998746:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509643.998752:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509643.998947:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796888576 00000100:00100000:1.0:1788509643.998953:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796888576 00000100:00100000:1.0:1788509643.998988:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788509643.998996:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3644:x1875387796888576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788509643.999038:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3644:x1875387796888576:12345-0@lo:400:kworker.0 Request processed in 43us (7052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509643.999045:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788509643.999088:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:830aae98-6419-4d90-97fb-7d4af2af47a0:3644:1875387796888576:0@lo:400:kworker.0 00000100:00100000:1.0:1788509643.999102:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788509643.999112:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796890240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509643.999147:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509643.999287:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875387796888960:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.999301:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875387796889472:0@lo:400:kworker.0 00010000:00080000:3.0:1788509643.999315:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87354a80 x1875387796889984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788509643.999337:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875387796889984:0@lo:400:kworker.0 00000100:00100000:3.0:1788509643.999373:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875387796889856:0@lo:400:kworker.0 00000100:00100000:2.0:1788509643.999598:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796890240 00000100:00100000:2.0:1788509643.999603:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796890240 00000100:00100000:2.0:1788509643.999627:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788509643.999633:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796890240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788509643.999647:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788509643.999690:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796890240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509643.999697:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788509643.999769:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796890240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788509644.056300:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509644.056356:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509644.056423:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774789632 00000100:00100000:0.0:1788509644.056446:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774789632 00000100:00100000:0.0:1788509644.056514:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:0.0:1788509644.056526:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:2409:x1875387774789632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509644.056629:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:2409:x1875387774789632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 103us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509644.056655:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:0.0:1788509644.080562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509644.084480:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774789760 00000100:00100000:2.0:1788509644.084500:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774789760 00000100:00100000:2.0:1788509644.084611:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788509644.084626:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2409:x1875387774789760:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509644.084738:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2409:x1875387774789760:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 115us (28380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509644.084747:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00080000:3.0:1788509644.085478:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509644.095589:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509644.095637:0:19531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774790016 00000100:00100000:0.0:1788509644.095649:0:19531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774790016 00000100:00100000:0.0:1788509644.095727:0:19531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788509644.095739:0:19531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774790016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509644.095827:0:19531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774790016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509644.095836:0:19531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788509644.095998:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774789888 00000100:00100000:1.0:1788509644.096004:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774789888 00000100:00100000:1.0:1788509644.096056:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788509644.096064:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774789888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509644.096099:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774789888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (15556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509644.096106:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00080000:0.0:1788509644.097171:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509644.097179:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788509644.097234:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509644.097466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509644.097590:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509644.097614:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509644.097641:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509644.097668:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774790272 00000100:00100000:0.0:1788509644.097676:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774790272 00000100:00100000:0.0:1788509644.097722:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774790400 00000100:00100000:0.0:1788509644.097725:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774790400 00000100:00100000:0.0:1788509644.097749:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788509644.097757:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+6:2410:x1875387774790272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509644.097817:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+6:2410:x1875387774790272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509644.097825:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788509644.097851:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788509644.097857:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774790400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509644.097884:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774790400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509644.097890:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788509644.098376:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774790144 00000100:00100000:0.0:1788509644.098383:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774790144 00000100:00100000:0.0:1788509644.098823:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774790528 00000100:00100000:0.0:1788509644.098827:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774790528 00000100:00100000:0.0:1788509644.098852:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774790656 00000100:00100000:0.0:1788509644.098855:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774790656 00000100:00100000:0.0:1788509644.098872:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1788509644.098879:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774790144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509644.102755:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774790144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3859us (5505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509644.102775:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1788509644.102825:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788509644.102841:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774790528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509644.102937:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774790528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 103us (5322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509644.102945:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788509644.102958:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788509644.102966:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774790656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509644.102993:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774790656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (5352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509644.103010:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00080000:0.0:1788509644.103047:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509644.103055:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509644.103059:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788509644.103062:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788509644.696160:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788509645.147297:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788509645.718369:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509646.742020:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788509646.825868:0:20169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff30643110 20000000:00000080:1.0:1788509646.825887:0:20169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bcdb7e91c00 uarg=0000000000000000 20000000:01000000:1.0:1788509646.826067:0:20169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788509646.826073:0:20169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788509646.826078:0:20169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788509646.826512:0:20170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788509646.826654:0:20169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788509646.834077:0:20169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788509646.834118:0:20169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834141:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deb92 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834149:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310deba0 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834157:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310debdf expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834164:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310dec79 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834175:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834203:0:20169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834211:0:20169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834269:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.834288:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 12 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509646.834306:0:20169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890368:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509646.835450:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.835466:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 12 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509646.835478:0:20169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890496:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509646.835623:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310dec79 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.835633:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310dec79 expref: 23 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509646.835643:0:20169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890624:0@lo:104: 00000100:00100000:1.0:1788509646.835699:0:20169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509646.835875:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310debdf expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.835885:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310debdf expref: 23 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509646.835893:0:20169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890752:0@lo:104: 00000100:00100000:1.0:1788509646.835940:0:20169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788509646.839872:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310deba0 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.839913:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310deba0 expref: 23 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509646.839931:0:20169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890880:0@lo:104: 00000100:00100000:1.0:1788509646.840018:0:20169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509646.850675:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796890624 00000100:00100000:0.0:1788509646.850697:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796890624 00000100:00100000:0.0:1788509646.851678:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796890752 00000100:00100000:0.0:1788509646.851687:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796890752 00000100:00100000:0.0:1788509646.851721:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509646.851733:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:20169:x1875387796890624:12345-0@lo:104: 00010000:00010000:0.0:1788509646.851890:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.852045:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788509646.852051:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+4:20169:x1875387796890624:12345-0@lo:104: Request processed in 322us (16354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509646.852059:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788509646.852090:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788509646.852097:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:20169:x1875387796890752:12345-0@lo:104: 00010000:00010000:0.0:1788509646.852894:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853009:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788509646.853017:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:830aae98-6419-4d90-97fb-7d4af2af47a0+3:20169:x1875387796890752:12345-0@lo:104: Request processed in 919us (17076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509646.853187:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788509646.853230:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509646.853308:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853319:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862aea00 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509646.853324:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853335:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509646.853345:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509646.853351:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788509646.853405:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853412:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509646.853450:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853458:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310dec79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310dec80 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853478:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509646.853482:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853668:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e400 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509646.853672:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853679:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509646.853686:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509646.853691:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788509646.853707:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853714:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509646.853720:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853727:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc8846e400/0xe5156b86310debdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310debe6 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.853739:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509646.853741:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509646.853743:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509646.853823:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509646.853858:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796891008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509646.853943:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509646.854465:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788509646.854476:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796891136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509646.855532:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509646.855619:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796891008 00000100:00100000:0.0:1788509646.855629:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796891008 00010000:00010000:0.0:1788509646.855674:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dec79 expref: 24 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509646.855717:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796891136 00000100:00100000:0.0:1788509646.855721:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796891136 00010000:00010000:0.0:1788509646.855736:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310debdf expref: 25 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509646.855761:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788509646.855781:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+25:3646:x1875387796891008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788509646.855800:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509646.855810:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310dec79 expref: 25 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509646.855824:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310dec79 expref: 25 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509646.855844:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509646.855931:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+25:3646:x1875387796891008:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509646.855939:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788509646.858601:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509646.858638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509646.858666:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774790784 00000100:00100000:2.0:1788509646.858674:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774790784 00010000:00010000:2.0:1788509646.858704:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 13 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509646.858725:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774790912 00000100:00100000:2.0:1788509646.858728:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774790912 00010000:00010000:2.0:1788509646.858739:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 14 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509646.858758:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788509646.858766:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+14:2407:x1875387774790784:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509646.858778:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509646.858783:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 14 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.858809:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 14 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.858829:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509646.858895:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+14:2407:x1875387774790784:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 129us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509646.858920:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788509646.858938:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788509646.858945:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:2407:x1875387774790912:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509646.858953:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509646.858958:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 13 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.858966:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 13 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.858975:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509646.858994:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:2407:x1875387774790912:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 49us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509646.858999:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788509646.859041:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796891008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509646.860831:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788509646.860852:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3646:x1875387796891136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788509646.860875:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509646.860886:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310debdf expref: 24 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.860926:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310debdf expref: 24 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.860949:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509646.861043:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3646:x1875387796891136:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (5516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509646.867989:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:830aae98-6419-4d90-97fb-7d4af2af47a0:3646:1875387796891136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509646.869314:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788509646.869774:0:20169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe5156b86310deb92 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.869794:0:20169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe5156b86310deb92 expref: 23 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509646.869812:0:20169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796891264:0@lo:104: 00000100:00100000:1.0:1788509646.869886:0:20169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509646.869962:0:20169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788509646.869993:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796890880 00010000:00010000:1.0:1788509646.870003:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1226e00/0xe5156b86310deed3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475534f5 expref: 12 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509646.870008:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796890880 00000100:00100000:1.0:1788509646.870024:0:20169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890368:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509646.870039:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdb1227200/0xe5156b86310dee94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553485 expref: 11 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509646.870060:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796891264 00000100:00100000:3.0:1788509646.870067:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796891264 00000100:00100000:1.0:1788509646.870079:0:20169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890496:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509646.870099:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788509646.870104:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc8846e800/0xe5156b86310dec80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310dec79 expref: 23 pid: 17137 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509646.870114:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+4:20169:x1875387796890880:12345-0@lo:104: 00000100:00100000:1.0:1788509646.870124:0:20169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890624:0@lo:104: 00010000:00010000:3.0:1788509646.870135:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.870142:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcdbd3d8a00/0xe5156b86310debe6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310debdf expref: 22 pid: 17138 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509646.870158:0:20169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890752:0@lo:104: 00010000:00010000:3.0:1788509646.870405:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788509646.870413:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+4:20169:x1875387796890880:12345-0@lo:104: Request processed in 303us (30394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509646.870432:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788509646.870448:0:20169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796890880:0@lo:104: 00000100:00100000:3.0:1788509646.870461:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788509646.870470:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+3:20169:x1875387796891264:12345-0@lo:104: 00010000:00010000:3.0:1788509646.870479:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509646.870530:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788509646.870536:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:830aae98-6419-4d90-97fb-7d4af2af47a0+3:20169:x1875387796891264:12345-0@lo:104: Request processed in 68us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509646.870542:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788509646.870610:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788509646.870621:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870630:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f800 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509646.870635:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870655:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509646.870670:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509646.870677:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788509646.870721:0:20169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20169:1875387796891264:0@lo:104: 00010000:00010000:0.0:1788509646.870733:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870742:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509646.870780:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870787:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f800/0xe5156b86310deba0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deba7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870801:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509646.870804:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870809:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc87ce2000 already unused, calling callback (ffffffffc1422c20) 10000000:00010000:0.0:1788509646.870812:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870819:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788509646.870826:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.870833:0:20169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509646.870858:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788509646.870883:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870891:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788509646.870957:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870964:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8bcc87ce2000/0xe5156b86310deb92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe5156b86310deb99 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.870985:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509646.870988:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509646.870990:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509646.871007:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796891520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509646.871060:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509646.871114:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788509646.871121:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796891392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788509646.871141:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796891520 00000100:00100000:2.0:1788509646.871148:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796891520 00000100:00100000:0.0:1788509646.871154:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788509646.871186:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb92 expref: 22 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509646.871190:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509646.871224:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796891392 00000100:00100000:2.0:1788509646.871228:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796891392 00010000:00010000:2.0:1788509646.871242:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deba0 expref: 23 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509646.871390:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788509646.871398:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:3645:x1875387796891520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788509646.871409:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509646.871414:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deb92 expref: 23 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871443:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310deb92 expref: 23 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871460:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc87ce2600/0xe5156b86310deb99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310deb92 expref: 23 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871473:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509646.871514:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+22:3645:x1875387796891520:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509646.871521:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788509646.871565:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788509646.871571:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:3645:x1875387796891392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788509646.871578:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509646.871583:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe5156b86310deba0 expref: 21 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871593:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe5156b86310deba0 expref: 21 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871610:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc87ce3c00/0xe5156b86310deba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe5156b86310deba0 expref: 21 pid: 17139 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871621:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871630:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871644:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871651:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871658:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871665:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871671:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc862afa00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:2.0:1788509646.871675:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871683:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871695:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509646.871713:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509646.871737:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:830aae98-6419-4d90-97fb-7d4af2af47a0+20:3645:x1875387796891392:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509646.871743:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788509646.872308:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796891392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788509646.872322:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:830aae98-6419-4d90-97fb-7d4af2af47a0:3645:1875387796891520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788509646.872872:0:20169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.872885:0:20169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509646.872893:0:20169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bcc862afa00/0xe5156b86310def04 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509647.062577:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796891648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509647.062654:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509647.063005:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796891648 00000100:00100000:0.0:1788509647.063017:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796891648 00000100:00100000:0.0:1788509647.063101:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788509647.063116:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796891648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509647.063181:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509647.063278:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796891648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509647.063286:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788509647.063358:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796891648:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788509647.063434:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788509647.766357:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509647.963456:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509647.963770:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774791040 00000100:00100000:3.0:1788509647.963780:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774791040 00000100:00100000:3.0:1788509647.963828:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:3.0:1788509647.963837:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+11:14911:x1875387774791040:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509647.963852:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509647.963868:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80031600/0xe5156b86310def0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e464755352d expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509647.964032:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80031600/0xe5156b86310def0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755352d expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509647.964047:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80031600/0xe5156b86310def0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755352d expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509647.964674:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031600, rc 0) 00000100:00100000:3.0:1788509647.964768:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:14911:x1875387774791040:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 930us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509647.964777:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:0.0:1788509647.972497:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509647.972567:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774791168 00000100:00100000:2.0:1788509647.972575:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774791168 00000100:00100000:2.0:1788509647.972700:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:2.0:1788509647.972710:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc81725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:14911:x1875387774791168:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509647.972850:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc81725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:14911:x1875387774791168:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 141us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509647.972858:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:1.0:1788509647.981387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509647.983516:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774791296 00000100:00100000:3.0:1788509647.983527:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774791296 00000100:00100000:3.0:1788509647.983581:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:3.0:1788509647.983591:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:14911:x1875387774791296:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509647.983735:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:14911:x1875387774791296:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 145us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509647.983743:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:0.0:1788509647.999978:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509648.000302:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774791424 00000100:00100000:2.0:1788509648.000311:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774791424 00000100:00100000:2.0:1788509648.000376:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:2.0:1788509648.000386:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+12:14911:x1875387774791424:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788509648.000401:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509648.000427:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcdb1227600/0xe5156b86310def12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a882e4647553534 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509648.000453:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcdb1227600/0xe5156b86310def12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553534 expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509648.000465:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcdb1227600/0xe5156b86310def12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553534 expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509648.000482:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227600, rc 0) 00000100:00100000:2.0:1788509648.000533:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:14911:x1875387774791424:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 148us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509648.000541:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:0.0:1788509648.011155:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509648.011248:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774791552 00000100:00100000:2.0:1788509648.011257:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774791552 00000100:00100000:2.0:1788509648.011310:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:2.0:1788509648.011327:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:14911:x1875387774791552:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509648.011473:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:14911:x1875387774791552:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 146us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509648.011481:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:1.0:1788509648.024449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509648.024526:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774791680 00000100:00100000:0.0:1788509648.024535:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774791680 00000100:00100000:0.0:1788509648.024587:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:0.0:1788509648.024597:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:14911:x1875387774791680:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788509648.024725:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:14911:x1875387774791680:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 130us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509648.024734:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:3.0:1788509648.086305:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796891776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788509648.086429:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509648.086619:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796891776 00000100:00100000:2.0:1788509648.086638:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796891776 00000100:00100000:2.0:1788509648.086683:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788509648.086691:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796891776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509648.086722:0:17886:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788509648.086935:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788509648.086944:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796891904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788509648.086971:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509648.087021:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796891904 00000100:00100000:3.0:1788509648.087025:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796891904 00000100:00100000:3.0:1788509648.087058:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788509648.087073:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796891904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788509648.087092:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788509648.087132:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796891904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509648.087138:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788509648.087191:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796891904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509648.087424:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796891776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 733us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509648.087430:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788509648.087635:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796891776:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1788509648.343440:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509648.343449:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcc870b2800 from 13 10000000:01000000:0.0:1788509648.343454:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509648.343502:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f600/0xe5156b86310def19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.343514:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f600/0xe5156b86310def19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.343526:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f600/0xe5156b86310def19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509648.343557:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509648.343625:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509648.343678:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788509648.343734:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796892032 00000100:00100000:3.0:1788509648.343750:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796892032 00000100:00100000:3.0:1788509648.343805:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788509648.343815:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+20:17142:x1875387796892032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509648.343828:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509648.343841:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80031a00/0xe5156b86310def20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310def19 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.343863:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80031a00/0xe5156b86310def20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310def19 expref: 21 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.343874:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80031a00/0xe5156b86310def20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310def19 expref: 21 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.343884:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031a00, rc 0) 00000100:00100000:3.0:1788509648.343940:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796892032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509648.344505:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788509648.344554:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509648.344571:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f600/0xe5156b86310def19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def20 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.344581:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f600/0xe5156b86310def19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310def20 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509648.344636:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.344671:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509648.344737:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcdb5a84780 going to sleep for 11 seconds 00000100:00100000:0.0:1788509648.344795:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796892160 00000100:00100000:0.0:1788509648.344800:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796892160 00000100:00100000:0.0:1788509648.344837:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788509648.344844:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796892160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509648.344975:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796892160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509648.344982:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788509648.345456:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509648.345500:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509648.345557:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509648.345679:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788509648.346970:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796892288 00000100:00100000:3.0:1788509648.346978:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796892288 00000100:00100000:3.0:1788509648.347017:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788509648.347025:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796892288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.347143:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796892288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509648.347151:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788509648.351649:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788509648.356457:0:20219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788509648.356626:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788509648.356649:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788509648.356660:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f600/0xe5156b86310def19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def20 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509648.356672:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f600/0xe5156b86310def19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def20 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509648.356683:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788509648.356685:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd89112800 from 13 10000000:01000000:1.0:1788509648.356689:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788509648.356724:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310def27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509648.356732:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310def27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509648.356743:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310def27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509648.356766:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788509648.356825:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509648.356869:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788509648.357541:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796892416 00000100:00100000:3.0:1788509648.357550:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796892416 00000100:00100000:3.0:1788509648.357608:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788509648.357621:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+21:17142:x1875387796892416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509648.357635:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509648.357650:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80031400/0xe5156b86310def2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310def27 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.357675:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80031400/0xe5156b86310def2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310def27 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.357687:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80031400/0xe5156b86310def2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310def27 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.357696:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80031400, rc 0) 00000100:00100000:3.0:1788509648.357754:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+22:17142:x1875387796892416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509648.357761:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788509648.357790:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509648.357807:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310def27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def2e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.357817:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310def27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310def2e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509648.357884:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509648.357945:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509648.357968:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd850a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788509648.358569:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796892544 00000100:00100000:3.0:1788509648.358583:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796892544 00000100:00100000:3.0:1788509648.358632:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788509648.358639:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:17142:x1875387796892544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.358779:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+22:17142:x1875387796892544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509648.358786:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788509648.359254:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788509648.359308:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509648.359355:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509648.359378:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82cec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509648.359918:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796892672 00000100:00100000:3.0:1788509648.359925:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796892672 00000100:00100000:3.0:1788509648.359958:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788509648.359965:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+22:17142:x1875387796892672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.360063:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+22:17142:x1875387796892672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509648.360248:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.360467:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000040:00080000:3.0:1788509648.365622:0:20220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788509648.366862:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788509648.366994:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788509648.367007:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310def27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def2e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509648.367019:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc862aea00/0xe5156b86310def27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def2e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788509648.367031:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788509648.367034:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcd83147800 from 13 10000000:01000000:1.0:1788509648.367036:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788509648.367072:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862afa00/0xe5156b86310def35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509648.367080:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc862afa00/0xe5156b86310def35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509648.367091:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc862afa00/0xe5156b86310def35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509648.367113:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788509648.367174:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509648.367219:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd82cec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509648.367399:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796892800 00000100:00100000:0.0:1788509648.367415:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796892800 00000100:00100000:0.0:1788509648.367463:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788509648.367472:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+22:17142:x1875387796892800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509648.367484:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509648.367508:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310def3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310def35 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.367532:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310def3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310def35 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.367544:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcc8846fe00/0xe5156b86310def3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310def35 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.367553:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846fe00, rc 0) 00000100:00100000:0.0:1788509648.367611:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796892800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509648.367618:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788509648.369752:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87355c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509648.369779:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc862afa00/0xe5156b86310def35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def3c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.369791:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc862afa00/0xe5156b86310def35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310def3c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509648.369878:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.369942:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509648.369979:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8109a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788509648.370325:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796892928 00000100:00100000:0.0:1788509648.370332:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796892928 00000100:00100000:0.0:1788509648.370376:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788509648.370385:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796892928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509648.370517:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796892928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509648.370524:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788509648.370554:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796892928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.370583:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796893056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.370637:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509648.370773:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8109a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788509648.370814:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796893056 00000100:00100000:1.0:1788509648.370818:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796893056 00000100:00100000:1.0:1788509648.370847:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788509648.370869:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796893056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788509648.370985:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796893056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509648.370992:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788509648.371174:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796893056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788509648.375880:0:20221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788509648.376175:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788509648.376199:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509648.376210:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc862afa00/0xe5156b86310def35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def3c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.376222:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc862afa00/0xe5156b86310def35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def3c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788509648.376250:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788509648.376253:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bcc870ca000 from 13 10000000:01000000:0.0:1788509648.376264:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788509648.376298:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f400/0xe5156b86310def43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.376306:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f400/0xe5156b86310def43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.376316:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f400/0xe5156b86310def43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509648.376339:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796893184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788509648.376398:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509648.376442:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a0249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509648.376494:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796893184 00000100:00100000:3.0:1788509648.376501:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796893184 00000100:00100000:3.0:1788509648.376547:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788509648.376555:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+23:17142:x1875387796893184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788509648.376568:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509648.376584:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bcd80030600/0xe5156b86310def4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe5156b86310def43 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.376607:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bcd80030600/0xe5156b86310def4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe5156b86310def43 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.376618:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bcd80030600/0xe5156b86310def4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe5156b86310def43 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509648.376628:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030600, rc 0) 00000100:00100000:3.0:1788509648.376678:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:830aae98-6419-4d90-97fb-7d4af2af47a0+24:17142:x1875387796893184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509648.376685:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788509648.376756:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796893184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788509648.376768:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f400/0xe5156b86310def43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def4a expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.376777:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f400/0xe5156b86310def43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe5156b86310def4a expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509648.376839:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796893312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788509648.376861:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509648.376880:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcd8a0249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788509648.376992:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796893312 00000100:00100000:3.0:1788509648.376996:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796893312 00000100:00100000:3.0:1788509648.377024:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788509648.377030:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:17142:x1875387796893312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.377127:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:17142:x1875387796893312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509648.377133:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788509648.377365:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796893312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788509648.377396:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796893440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788509648.377448:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509648.377476:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc81ae6900 going to sleep for 11 seconds 00000100:00100000:3.0:1788509648.377978:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796893440 00000100:00100000:3.0:1788509648.377989:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796893440 00000100:00100000:3.0:1788509648.378011:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788509648.378017:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8172c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:17142:x1875387796893440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788509648.378096:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8172c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:830aae98-6419-4d90-97fb-7d4af2af47a0+24:17142:x1875387796893440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509648.378103:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788509648.378169:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:830aae98-6419-4d90-97fb-7d4af2af47a0:17142:1875387796893440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788509648.382340:0:20222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788509648.386543:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788509648.386582:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788509648.386609:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f400/0xe5156b86310def43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def4a expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.386622:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8bcc8846f400/0xe5156b86310def43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe5156b86310def4a expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509648.790026:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788509648.921663:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788509649.111586:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509649.111610:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796893568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788509649.111676:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509649.114930:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796893568 00000100:00100000:0.0:1788509649.114944:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796893568 00000100:00100000:0.0:1788509649.115015:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788509649.115026:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796893568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788509649.115068:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509649.115156:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796893568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (3479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.115164:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788509649.115479:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796893696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509649.115520:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788509649.115602:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509649.118625:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509649.118645:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796893952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788509649.118707:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.118748:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796893824:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.118776:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.118917:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796894080:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.118942:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.118985:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796894080 00000100:00100000:2.0:1788509649.118992:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796894080 00000100:00100000:2.0:1788509649.119036:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788509649.119044:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796894080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.119294:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796894080:12345-0@lo:400:kworker.0 Request processed in 249us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509649.119301:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788509649.119550:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796894080:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.119587:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509649.119595:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796894208:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.119623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.119663:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc88567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796894336:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.119684:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.119722:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509649.119738:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796894464:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.119766:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.119803:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796894592:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.119824:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.119863:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788509649.119868:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796894720:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.119888:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.119944:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796894848:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.119966:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509649.120003:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788509649.120009:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796894976:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.120034:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509649.120412:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796893824 00000100:00100000:1.0:1788509649.120419:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796893824 00000100:00100000:1.0:1788509649.120461:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788509649.120470:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3647:x1875387796893824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.120689:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796893696 00000100:00100000:0.0:1788509649.120694:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796893696 00000100:00100000:0.0:1788509649.120732:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796893952 00000100:00100000:0.0:1788509649.120745:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796893952 00000100:00100000:0.0:1788509649.120763:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788509649.120769:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796893696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788509649.120792:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788509649.120835:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875387796893696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (5314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.120842:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788509649.120857:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788509649.120872:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796893952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788509649.120884:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788509649.121017:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788509649.121318:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3647:x1875387796893824:12345-0@lo:400:kworker.0 Request processed in 849us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509649.121326:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788509649.121443:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796893824:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.121473:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796895104:0@lo:400:kworker.0 00000100:00100000:2.0:1788509649.121503:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509649.121550:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796893952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 677us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.121556:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788509649.121580:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796894208 00000100:00100000:0.0:1788509649.121584:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796894208 00000100:00100000:0.0:1788509649.121604:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796894592 00000100:00100000:0.0:1788509649.121606:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796894592 00000100:00100000:0.0:1788509649.121615:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796894720 00000100:00100000:0.0:1788509649.121617:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796894720 00000100:00100000:0.0:1788509649.121646:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796894848 00000100:00100000:0.0:1788509649.121649:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796894848 00000100:00100000:0.0:1788509649.121664:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796894976 00000100:00100000:0.0:1788509649.121666:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796894976 00000100:00100000:0.0:1788509649.121678:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796895104 00000100:00100000:0.0:1788509649.121681:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796895104 00000100:00100000:0.0:1788509649.121694:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788509649.121701:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc88565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796894208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.121755:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc88565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796894208:12345-0@lo:400:kworker.0 Request processed in 54us (2130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.121761:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788509649.121772:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788509649.121778:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796894592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.121804:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875387796894592:12345-0@lo:400:kworker.0 Request processed in 27us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.121809:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788509649.121819:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788509649.121825:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796894720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.121861:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875387796894720:12345-0@lo:400:kworker.0 Request processed in 37us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.121867:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788509649.121879:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788509649.121884:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796894848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.121937:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875387796894848:12345-0@lo:400:kworker.0 Request processed in 52us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.121943:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788509649.121955:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788509649.121960:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796894976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.121988:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875387796894976:12345-0@lo:400:kworker.0 Request processed in 27us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.121993:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788509649.122003:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788509649.122009:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796895104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.122034:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875387796895104:12345-0@lo:400:kworker.0 Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.122040:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788509649.122056:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796894336 00000100:00100000:0.0:1788509649.122059:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796894336 00000100:00100000:0.0:1788509649.122082:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788509649.122088:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796894336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.122132:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796894336:12345-0@lo:400:kworker.0 Request processed in 44us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.122137:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788509649.122161:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796894464 00000100:00100000:0.0:1788509649.122165:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796894464 00010000:00080000:1.0:1788509649.122432:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87dfd880 x1875387796894848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509649.122445:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875387796894848:0@lo:400:kworker.0 00000100:00100000:1.0:1788509649.122461:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875387796894720:0@lo:400:kworker.0 00000100:00100000:1.0:1788509649.122471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796894336:0@lo:400:kworker.0 00000100:00100000:1.0:1788509649.122481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc88564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796894208:0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.122524:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788509649.122534:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796894464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509649.122572:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796894464:12345-0@lo:400:kworker.0 Request processed in 40us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.122577:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788509649.122632:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875387796893696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788509649.122670:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc865dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796893568:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788509649.122759:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788509649.122764:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788509649.122765:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788509649.122867:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796893952:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788509649.122888:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcc87dfed80 x1875387796895104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788509649.123048:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875387796895104:0@lo:400:kworker.0 00000100:00100000:3.0:1788509649.123192:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875387796894976:0@lo:400:kworker.0 00000100:00100000:3.0:1788509649.123274:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb5c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875387796894592:0@lo:400:kworker.0 00000100:00100000:3.0:1788509649.123284:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796894464:0@lo:400:kworker.0 00000100:00100000:1.0:1788509649.189824:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.189870:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.189938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.189959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.189975:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.189991:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.190027:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.190059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.190084:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509649.190112:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774792320 00000100:00100000:1.0:1788509649.190121:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774792320 00000100:00100000:1.0:1788509649.190173:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774792832 00000100:00100000:1.0:1788509649.190177:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774792832 00000100:00100000:1.0:1788509649.190190:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774792192 00000100:00100000:3.0:1788509649.190314:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774792064 00000100:00100000:3.0:1788509649.190318:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774792064 00000100:00100000:3.0:1788509649.190347:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774792576 00000100:00100000:3.0:1788509649.190350:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774792576 00000100:00100000:3.0:1788509649.190362:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774791936 00000100:00100000:3.0:1788509649.190364:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774791936 00000100:00100000:3.0:1788509649.190374:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774792448 00000100:00100000:3.0:1788509649.190377:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774792448 00000100:00100000:3.0:1788509649.190394:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788509649.190415:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774792064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509649.190497:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774792064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509649.190506:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788509649.190524:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788509649.190531:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774792576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509649.190554:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774792576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509649.190561:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788509649.190572:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788509649.190578:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2410:x1875387774791936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509649.190601:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2410:x1875387774791936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509649.190607:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788509649.190618:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788509649.190624:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+6:2410:x1875387774792448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509649.190646:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+6:2410:x1875387774792448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509649.190652:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1788509649.190703:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774792192 00000100:00100000:1.0:1788509649.190725:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774792704 00000100:00100000:1.0:1788509649.190728:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774792704 00000100:00100000:1.0:1788509649.190741:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788509649.190748:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774792320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509649.190775:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774792320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509649.190782:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788509649.190794:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788509649.190800:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774792832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509649.190821:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774792832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509649.190826:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788509649.190837:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788509649.190843:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774792192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509649.190863:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774792192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509649.190869:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788509649.190888:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788509649.190894:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774792704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509649.191633:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774791808 00000100:00100000:0.0:1788509649.191639:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774791808 00000100:00100000:0.0:1788509649.191681:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:0.0:1788509649.191687:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:2410:x1875387774791808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788509649.191718:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:2410:x1875387774791808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509649.191723:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:1.0:1788509649.192965:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774792704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1732us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509649.192975:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00080000:1.0:1788509649.193003:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788509649.193007:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788509649.193010:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788509649.193012:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788509649.814080:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509650.838978:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788509650.919250:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509650.919484:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774792960 00000100:00100000:1.0:1788509650.919498:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774792960 00000100:00100000:1.0:1788509650.919585:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788509650.919597:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb789a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:15581:x1875387774792960:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509650.919625:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509650.919653:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925400/0xe5156b86310def51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755353b expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.919751:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.919769:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.919786:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.919804:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.919811:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.919837:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.919984:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925800/0xe5156b86310def66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.919992:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925800/0xe5156b86310def66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920000:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925800/0xe5156b86310def66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509650.920035:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788509650.920039:0:19934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509650.920086:0:19934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925800/0xe5156b86310def66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920098:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920106:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920114:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920122:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509650.920127:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920135:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920157:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc8761cc00) 00010000:00010000:1.0:1788509650.920160:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509650.920166:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920173:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310def58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920190:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920197:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920203:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920209:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509650.920212:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920218:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920225:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8bcc87343f00) 00010000:00010000:1.0:1788509650.920227:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509650.920230:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920235:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310def5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920286:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925400/0xe5156b86310def51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755353b expref: 8 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920314:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925800/0xe5156b86310def66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755353b expref: 7 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509650.920323:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8bcc87343200) 00010000:00010000:1.0:1788509650.920325:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788509650.920328:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92925800, rc 0) 00000100:00100000:1.0:1788509650.920682:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb789a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:15581:x1875387774792960:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1085us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509650.920693:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788509650.925322:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509650.926794:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774793088 00000100:00100000:2.0:1788509650.926808:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774793088 00000100:00100000:2.0:1788509650.926885:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788509650.926913:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:15581:x1875387774793088:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788509650.927008:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:15581:x1875387774793088:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 114us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509650.927029:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788509650.937529:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509650.937663:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774793344 00000100:00100000:0.0:1788509650.937676:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774793344 00000100:00100000:0.0:1788509650.937771:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788509650.937783:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:15581:x1875387774793344:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788509650.937812:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509650.937856:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310def6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553542 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938020:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938038:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938052:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938521:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938545:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938558:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938701:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310def82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938709:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310def82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.938717:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310def82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509650.938729:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788509650.938999:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939017:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939024:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939029:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509650.939033:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939041:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939054:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8bcc87343200) 00010000:00010000:0.0:1788509650.939057:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509650.939062:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939068:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310def74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939082:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939089:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939094:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939099:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509650.939109:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939115:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939123:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8bcc86027400) 00010000:00010000:0.0:1788509650.939125:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509650.939128:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.939134:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310def7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.944209:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310def6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553542 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.944248:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e200/0xe5156b86310def82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553542 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509650.944267:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc86027200) 00010000:00010000:0.0:1788509650.944270:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509650.944276:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846e200, rc 0) 00000100:00100000:0.0:1788509650.944403:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:15581:x1875387774793344:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 6620us (6888us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788509650.944415:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788509650.965826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509650.965964:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774793472 00000100:00100000:2.0:1788509650.965973:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774793472 00000100:00100000:2.0:1788509650.966032:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788509650.966041:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:15581:x1875387774793472:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788509650.966153:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:15581:x1875387774793472:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509650.966161:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788509650.971790:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509650.981991:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774793600 00000100:00100000:0.0:1788509650.982004:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774793600 00000100:00100000:0.0:1788509650.982131:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788509650.982142:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:15581:x1875387774793600:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788509650.988196:0:17146:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5998us 00000100:00100000:0.0:1788509651.019839:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:15581:x1875387774793600:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 37688us (48048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509651.019854:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788509651.049072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.049970:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774793728 00000100:00100000:2.0:1788509651.049981:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774793728 00000100:00100000:2.0:1788509651.050262:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788509651.050275:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb5c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:15587:x1875387774793728:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509651.050307:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509651.050331:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310def90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553549 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050409:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050438:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050451:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050466:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050487:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050494:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050544:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050551:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050558:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050575:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509651.050580:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050588:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050600:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc8761cc00) 00010000:00010000:2.0:1788509651.050603:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509651.050607:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050613:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227800/0xe5156b86310def97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050627:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050639:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050646:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.050651:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509651.050655:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.051417:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.053418:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bcdbd047200) 00010000:00010000:2.0:1788509651.053481:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509651.053489:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.053498:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310def9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.053558:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310def90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553549 expref: 10 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.053569:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc8761cc00) 00010000:00010000:2.0:1788509651.053923:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509651.054095:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310def90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553549 expref: 10 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.054131:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226200, rc 0) 00000100:00100000:0.0:1788509651.054285:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb5c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:15587:x1875387774793728:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 4011us (5220us total) trans 0 rc 301/301 00000100:00100000:0.0:1788509651.054303:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00080000:3.0:1788509651.056996:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788509651.075988:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.076135:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774793856 00000100:00100000:2.0:1788509651.076145:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774793856 00000100:00100000:2.0:1788509651.076202:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788509651.076212:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:15587:x1875387774793856:12345-192.168.203.12@tcp:700:lfs.0 00000100:00100000:2.0:1788509651.076317:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:15587:x1875387774793856:12345-192.168.203.12@tcp:700:lfs.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509651.076325:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788509651.078263:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509651.078416:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774794112 00000100:00100000:0.0:1788509651.078436:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774794112 00000100:00100000:0.0:1788509651.078493:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788509651.078502:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:15587:x1875387774794112:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1788509651.078554:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509651.078592:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc862ae000/0xe5156b86310deebe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475534b6 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.078611:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc8761cc00) 00010000:00010000:0.0:1788509651.078616:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509651.078680:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.078693:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 5 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.078702:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.079160:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 5 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.079189:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 5 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509651.079206:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17145:1875387796895232:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509651.079469:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87436cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509651.083381:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17145:1875387796895232:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509651.083516:0:17145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509651.095169:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509651.095290:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774794240 00000100:00100000:0.0:1788509651.095315:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774794240 00010000:00010000:0.0:1788509651.095540:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 6 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509651.095597:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788509651.095609:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:969fd51c-5e49-4545-9833-40161db51328+6:2408:x1875387774794240:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509651.095629:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509651.095638:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 6 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.095652:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 6 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.095679:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310deefd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553526 expref: 6 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.095699:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc8761cc00) 00010000:00010000:0.0:1788509651.095705:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.095750:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.095759:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.095794:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509651.095880:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:969fd51c-5e49-4545-9833-40161db51328+5:2408:x1875387774794240:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 273us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509651.095889:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00080000:3.0:1788509651.097060:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788509651.097144:0:17145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.097158:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.097196:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.097210:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.097221:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105368:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105402:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105416:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509651.105456:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007218a4ba reply state 000000005ad32c55 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105468:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105477:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:0.0:1788509651.105480:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509651.105485:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788509651.105491:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788509651.105508:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105535:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105541:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105547:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509651.105551:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105559:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105569:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc8761cc00) 00010000:00010000:0.0:1788509651.105572:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509651.105575:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105581:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defa5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509651.105604:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007218a4ba reply state 000000005ad32c55 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105612:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.105619:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bcdbd047200) 00010000:00010000:0.0:1788509651.105621:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509651.105624:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788509651.105733:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+10:15587:x1875387774794112:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 27227us (27472us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788509651.105748:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788509651.238868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509651.239053:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774794368 00000100:00100000:1.0:1788509651.239064:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774794368 00000100:00100000:1.0:1788509651.239126:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1788509651.239136:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+10:15595:x1875387774794368:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:1.0:1788509651.239159:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509651.239191:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310defba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553550 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.239257:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310defc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.239271:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310defc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.239298:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310defc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509651.239343:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788509651.239347:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509651.239381:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310defc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.239417:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310defba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553550 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.239449:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924600/0xe5156b86310defc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553550 expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.239458:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87343f00) 00010000:00010000:1.0:1788509651.239461:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788509651.239465:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924600, rc 0) 00000100:00100000:1.0:1788509651.239527:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+11:15595:x1875387774794368:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 392us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509651.239534:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1788509651.287708:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509651.288093:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774794496 00000100:00100000:0.0:1788509651.288107:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774794496 00000100:00100000:0.0:1788509651.288194:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1788509651.288207:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+5:15596:x1875387774794496:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509651.288232:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509651.288259:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553557 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.288343:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310defcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.288376:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310defcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.288399:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310defcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509651.288455:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788509651.288459:0:17146:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509651.288483:0:17146:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310defcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.288510:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310defc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553557 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.288533:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e800/0xe5156b86310defcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553557 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.288566:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87343f00) 00010000:00010000:0.0:1788509651.288569:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509651.288574:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846e800, rc 0) 00000100:00100000:0.0:1788509651.288661:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+6:15596:x1875387774794496:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 456us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509651.288669:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1788509651.291767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509651.292035:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774794624 00000100:00100000:1.0:1788509651.292048:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774794624 00000100:00100000:1.0:1788509651.292124:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788509651.292135:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:969fd51c-5e49-4545-9833-40161db51328+6:15596:x1875387774794624:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788509651.292161:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509651.292188:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925e00/0xe5156b86310defd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755355e expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292296:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292315:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292329:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292342:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292350:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292374:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292486:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924200/0xe5156b86310defeb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292495:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924200/0xe5156b86310defeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292503:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924200/0xe5156b86310defeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509651.292551:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788509651.292556:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509651.292584:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924200/0xe5156b86310defeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292609:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292616:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292623:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292630:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924800 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509651.292635:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292643:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292657:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87343f00) 00010000:00010000:1.0:1788509651.292660:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509651.292666:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292673:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924800/0xe5156b86310defdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292690:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292696:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292701:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292716:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924e00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509651.292719:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292738:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292746:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bcdbd047200) 00010000:00010000:1.0:1788509651.292749:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509651.292753:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292759:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924e00/0xe5156b86310defe4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292790:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925e00/0xe5156b86310defd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755355e expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292806:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924200/0xe5156b86310defeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755355e expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.292814:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:1.0:1788509651.292817:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788509651.292820:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924200, rc 0) 00000100:00100000:1.0:1788509651.294594:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:969fd51c-5e49-4545-9833-40161db51328+7:15596:x1875387774794624:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2447us (2829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509651.294609:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788509651.298764:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.299593:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774794752 00000100:00100000:2.0:1788509651.299607:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774794752 00000100:00100000:2.0:1788509651.300076:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788509651.300091:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:969fd51c-5e49-4545-9833-40161db51328+5:15596:x1875387774794752:12345-192.168.203.12@tcp:900:lfs.0 00000100:00100000:2.0:1788509651.300202:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:969fd51c-5e49-4545-9833-40161db51328+5:15596:x1875387774794752:12345-192.168.203.12@tcp:900:lfs.0 Request processed in 115us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509651.300210:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00080000:3.0:1788509651.304121:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509651.304558:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509651.304644:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774795008 00000100:00100000:3.0:1788509651.304657:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774795008 00000100:00100000:3.0:1788509651.304736:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788509651.304749:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+7:15596:x1875387774795008:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788509651.304778:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509651.304808:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030400/0xe5156b86310deff2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553565 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788509651.304979:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788509651.305111:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030400/0xe5156b86310deff2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553565 expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509651.305129:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87343f00) 00010000:00010000:3.0:1788509651.305132:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788509651.305139:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030400/0xe5156b86310deff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553565 expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509651.305153:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030400, rc 0) 00000100:00100000:3.0:1788509651.305495:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+8:15596:x1875387774795008:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 747us (943us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788509651.305504:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1788509651.308629:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509651.308734:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774795264 00000100:00100000:0.0:1788509651.308747:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774795264 00000100:00100000:0.0:1788509651.308820:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788509651.308832:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+8:15596:x1875387774795264:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1788509651.308958:0:19934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509651.308992:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924200/0xe5156b86310defeb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755355e expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.309017:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:0.0:1788509651.309023:0:19934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509651.309053:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.309068:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.309081:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509651.309339:0:19934:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5626e90 reply state 000000002fa7af89 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.309576:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.309584:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:0.0:1788509651.309588:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788509651.309591:0:19934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788509651.309601:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788509651.309706:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+9:15596:x1875387774795264:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 875us (1090us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788509651.309715:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1788509651.315760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509651.316155:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774795520 00000100:00100000:3.0:1788509651.316168:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774795520 00000100:00100000:3.0:1788509651.316245:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788509651.316258:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:969fd51c-5e49-4545-9833-40161db51328+9:15596:x1875387774795520:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788509651.316611:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:969fd51c-5e49-4545-9833-40161db51328+10:15596:x1875387774795520:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 354us (863us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788509651.316621:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788509651.319570:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509651.319686:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774795776 00000100:00100000:0.0:1788509651.319699:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774795776 00000100:00100000:0.0:1788509651.319785:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788509651.319797:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+10:15596:x1875387774795776:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509651.319832:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509651.319859:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310df007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755356c expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320238:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320257:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320271:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320285:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320313:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320320:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509651.320463:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788509651.320558:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320567:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320574:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320581:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509651.320586:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320595:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320609:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87343f00) 00010000:00010000:0.0:1788509651.320612:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509651.320617:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320624:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e400/0xe5156b86310df00e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320653:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320660:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320666:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320671:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846f000 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509651.320674:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320681:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320689:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bcdbd047200) 00010000:00010000:0.0:1788509651.320692:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788509651.320695:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320701:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f000/0xe5156b86310df015 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320754:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310df007 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755356c expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320766:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87343f00) 00010000:00010000:0.0:1788509651.320769:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509651.320779:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846f800/0xe5156b86310df007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755356c expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.320790:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcc8846f800, rc 0) 00000100:00100000:0.0:1788509651.321315:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+11:15596:x1875387774795776:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1516us (1753us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788509651.321325:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1788509651.331797:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509651.332000:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774795904 00000100:00100000:0.0:1788509651.332013:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774795904 00000100:00100000:0.0:1788509651.332134:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788509651.332147:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+11:15596:x1875387774795904:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509651.332190:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509651.332218:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310df023 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553573 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.332693:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.332713:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.332739:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509651.332776:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788509651.332780:0:19934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788509651.332803:0:19934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.332836:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ea00/0xe5156b86310df023 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 13 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.332891:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 12 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.332943:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:0.0:1788509651.332947:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788509651.332951:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590be00, rc 0) 00000100:00100000:0.0:1788509651.333034:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:969fd51c-5e49-4545-9833-40161db51328+12:15596:x1875387774795904:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 889us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509651.333043:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788509651.336465:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.336602:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774796032 00000100:00100000:2.0:1788509651.336617:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774796032 00000100:00100000:2.0:1788509651.336703:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788509651.336715:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:969fd51c-5e49-4545-9833-40161db51328+12:15596:x1875387774796032:12345-192.168.203.12@tcp:37:lfs.0 00000100:00100000:2.0:1788509651.341892:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:969fd51c-5e49-4545-9833-40161db51328+12:15596:x1875387774796032:12345-192.168.203.12@tcp:37:lfs.0 Request processed in 5164us (5426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509651.341924:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788509651.346403:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509651.346542:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774796288 00000100:00100000:3.0:1788509651.346555:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774796288 00000100:00100000:3.0:1788509651.346628:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788509651.346640:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877a5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:969fd51c-5e49-4545-9833-40161db51328+12:15596:x1875387774796288:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788509651.347261:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877a5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:969fd51c-5e49-4545-9833-40161db51328+13:15596:x1875387774796288:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 620us (875us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788509651.347271:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000040:00080000:0.0:1788509651.350744:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788509651.400830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.401071:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774796416 00000100:00100000:2.0:1788509651.401083:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774796416 00000100:00100000:2.0:1788509651.401172:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788509651.401184:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+11:15602:x1875387774796416:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509651.401212:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509651.401239:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755357a expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401356:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401373:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401395:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401408:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401415:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401421:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401540:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227e00/0xe5156b86310df046 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401551:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227e00/0xe5156b86310df046 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401558:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227e00/0xe5156b86310df046 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509651.401606:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788509651.401610:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509651.401654:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227e00/0xe5156b86310df046 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401679:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401685:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401692:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401697:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509651.401702:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401711:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401724:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87343f00) 00010000:00010000:2.0:1788509651.401727:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509651.401732:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401739:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401755:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401760:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401765:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401776:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509651.401780:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401786:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401793:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bcdbd047200) 00010000:00010000:2.0:1788509651.401795:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509651.401798:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401803:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df03f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401833:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755357a expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401861:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227e00/0xe5156b86310df046 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755357a expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.401869:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:2.0:1788509651.401871:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788509651.401874:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227e00, rc 0) 00000100:00100000:2.0:1788509651.402010:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+12:15602:x1875387774796416:12345-192.168.203.12@tcp:101:bash.0 Request processed in 828us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509651.402018:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1788509651.405959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.406063:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774796544 00000100:00100000:2.0:1788509651.406095:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774796544 00000100:00100000:2.0:1788509651.406185:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788509651.406198:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:15602:x1875387774796544:12345-192.168.203.12@tcp:900:bash.0 00000100:00100000:2.0:1788509651.406322:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:15602:x1875387774796544:12345-192.168.203.12@tcp:900:bash.0 Request processed in 126us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509651.406332:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00080000:3.0:1788509651.406931:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509651.411638:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.411855:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774796800 00000100:00100000:2.0:1788509651.411869:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774796800 00000100:00100000:2.0:1788509651.411982:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1788509651.411994:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+12:15602:x1875387774796800:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509651.412023:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509651.412050:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df04d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553581 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.412209:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.412228:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 12 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.412239:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.412286:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 12 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.412304:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 12 pid: 19934 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509651.412344:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17144:1875387796895360:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509651.412462:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc81ae6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788509651.415330:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17144:1875387796895360:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788509651.415375:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509651.416984:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.417590:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774796928 00000100:00100000:2.0:1788509651.417605:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774796928 00010000:00010000:2.0:1788509651.417663:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 13 pid: 19934 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509651.417714:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788509651.417735:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:969fd51c-5e49-4545-9833-40161db51328+13:2407:x1875387774796928:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509651.417755:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509651.417764:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 13 pid: 19934 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.417779:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 13 pid: 19934 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.417810:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590be00/0xe5156b86310df02a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553573 expref: 13 pid: 19934 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.417832:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:2.0:1788509651.417838:0:17131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.417869:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.417878:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.417963:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509651.418037:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:969fd51c-5e49-4545-9833-40161db51328+12:2407:x1875387774796928:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 313us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509651.418045:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00010000:00010000:1.0:1788509651.418414:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.418425:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.418459:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.418469:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.418480:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419150:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419234:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419244:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509651.419258:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788509651.419360:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419369:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419398:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419405:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509651.419410:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419421:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419434:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:1.0:1788509651.419437:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509651.419441:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419448:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df054 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788509651.419463:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abef7e0c reply state 000000007a3e93b3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419476:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419482:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8bcc87343000) 00010000:00010000:1.0:1788509651.419485:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509651.419488:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788509651.419532:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df04d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419548:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 14 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509651.419563:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:1.0:1788509651.419566:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788509651.419569:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92924c00, rc 0) 00000100:00100000:1.0:1788509651.419629:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+15:15602:x1875387774796800:12345-192.168.203.12@tcp:101:bash.0 Request processed in 7637us (8006us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788509651.419638:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1788509651.434183:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.434410:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774797056 00000100:00100000:2.0:1788509651.434425:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774797056 00000100:00100000:2.0:1788509651.434510:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:2.0:1788509651.434523:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+15:15602:x1875387774797056:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788509651.434553:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509651.434579:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df070 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553588 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.434669:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.434687:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.434700:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509651.434771:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788509651.434776:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509651.434814:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.434828:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.434860:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df070 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.434883:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.434892:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509651.434894:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509651.434964:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227c00, rc 0) 00000100:00100000:2.0:1788509651.435040:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+16:15602:x1875387774797056:12345-192.168.203.12@tcp:101:bash.0 Request processed in 520us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509651.435047:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1788509651.438694:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.438792:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774797312 00000100:00100000:2.0:1788509651.438802:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774797312 00000100:00100000:2.0:1788509651.438867:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788509651.438875:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+16:15602:x1875387774797312:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788509651.439258:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+17:15602:x1875387774797312:12345-192.168.203.12@tcp:35:bash.0 Request processed in 381us (572us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788509651.439265:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788509651.581217:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509651.581578:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774797568 00000100:00100000:0.0:1788509651.581592:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774797568 00000100:00100000:0.0:1788509651.581690:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788509651.581716:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+17:15612:x1875387774797568:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788509651.581763:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509651.581807:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df07e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755358f expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509651.582062:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788509651.582228:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df07e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755358f expref: 19 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.582253:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bcc87343f00) 00010000:00010000:0.0:1788509651.582257:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509651.582283:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df07e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755358f expref: 19 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.582301:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590a200, rc 0) 00000100:00100000:0.0:1788509651.582423:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+18:15612:x1875387774797568:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 717us (1246us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788509651.582430:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788509651.594420:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.596431:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774797824 00000100:00100000:2.0:1788509651.596454:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774797824 00000100:00100000:2.0:1788509651.596673:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788509651.596687:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+18:15612:x1875387774797824:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788509651.597455:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+19:15612:x1875387774797824:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 767us (3045us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788509651.597473:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1788509651.697120:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.697228:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774798080 00000100:00100000:2.0:1788509651.697241:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774798080 00000100:00100000:2.0:1788509651.697322:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1788509651.697334:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+19:15615:x1875387774798080:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788509651.697366:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509651.697408:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226e00/0xe5156b86310df08c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e4647553596 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.697834:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df093 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.697865:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.697888:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509651.697949:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788509651.698086:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226e00/0xe5156b86310df08c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553596 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.698106:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df093 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553596 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509651.698116:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509651.698136:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509651.698142:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227200, rc 0) 00000100:00100000:2.0:1788509651.698625:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+21:15615:x1875387774798080:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1291us (1517us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788509651.698635:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788509651.710608:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509651.710841:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774798208 00000100:00100000:0.0:1788509651.710854:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774798208 00000100:00100000:0.0:1788509651.711046:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1788509651.711058:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+21:15615:x1875387774798208:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788509651.711149:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711171:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711186:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711249:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711257:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711265:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711271:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509651.711277:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711304:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711320:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:0.0:1788509651.711323:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788509651.711328:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.711335:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509651.711661:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+21:15615:x1875387774798208:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 601us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509651.711671:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788509651.719123:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509651.719274:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774798336 00000100:00100000:2.0:1788509651.719288:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774798336 00000100:00100000:0.0:1788509651.719479:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788509651.719494:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+21:2408:x1875387774798336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788509651.719515:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509651.719546:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df093 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553596 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509651.719569:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:0.0:1788509651.719576:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788509651.719637:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+20:2408:x1875387774798336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 147us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509651.719646:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788509651.728100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509651.728437:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774798592 00000100:00100000:3.0:1788509651.728450:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774798592 00000100:00100000:3.0:1788509651.728521:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788509651.728533:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+20:15615:x1875387774798592:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788509651.728943:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+21:15615:x1875387774798592:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 410us (857us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788509651.728951:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00010000:00010000:0.0:1788509651.863956:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788509651.990652:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788509652.185668:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796895488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509652.185800:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509652.186620:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796895488 00000100:00100000:0.0:1788509652.186634:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796895488 00000100:00100000:0.0:1788509652.186725:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788509652.186738:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796895488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509652.186781:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788509652.186877:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796895488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509652.186886:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788509652.188273:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509652.188450:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796895488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788509652.261624:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509652.261886:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774798848 00000100:00100000:0.0:1788509652.261937:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774798848 00000100:00100000:0.0:1788509652.262022:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1788509652.262033:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+21:15647:x1875387774798848:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788509652.262067:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509652.262094:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e464755359d expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.262245:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310df0af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.262263:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310df0af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.262278:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310df0af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788509652.262622:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788509652.262788:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755359d expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.262835:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310df0af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755359d expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.262845:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:0.0:1788509652.262849:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788509652.262853:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b800, rc 0) 00000100:00100000:0.0:1788509652.263049:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+23:15647:x1875387774798848:12345-192.168.203.12@tcp:101:cat.0 Request processed in 1016us (1437us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788509652.263058:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788509652.273054:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509652.273296:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774798976 00000100:00100000:3.0:1788509652.273311:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774798976 00000100:00100000:3.0:1788509652.273426:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788509652.273440:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+23:2409:x1875387774798976:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509652.273460:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509652.273496:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b800/0xe5156b86310df0af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e464755359d expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509652.273522:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:3.0:1788509652.273528:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509652.273596:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+22:2409:x1875387774798976:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 159us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509652.273604:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788509652.275657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509652.275792:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774799232 00000100:00100000:1.0:1788509652.275804:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774799232 00000100:00100000:1.0:1788509652.275887:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788509652.275924:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+22:15647:x1875387774799232:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:1.0:1788509652.276313:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+23:15647:x1875387774799232:12345-192.168.203.12@tcp:35:cat.0 Request processed in 416us (668us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788509652.276322:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788509652.338604:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509652.338970:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774799488 00000100:00100000:0.0:1788509652.338984:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774799488 00000100:00100000:0.0:1788509652.339066:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788509652.339078:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+23:15653:x1875387774799488:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1788509652.339108:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788509652.339136:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0bd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535a4 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.339278:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.339308:0:19934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.339318:0:19934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.339350:0:19934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.339404:0:19934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.339420:0:19934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 24 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509652.339436:0:19934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19934:1875387796895616:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509652.339557:0:19934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509652.339567:0:19934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 24 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509652.339578:0:19934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19934:1875387796895744:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509652.339601:0:19934:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87436b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788509652.346306:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509652.346365:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509652.346815:0:19934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19934:1875387796895616:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788509652.346832:0:19934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19934:1875387796895744:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509652.346865:0:19934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509652.347228:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774799616 00000100:00100000:2.0:1788509652.347239:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774799616 00010000:00010000:2.0:1788509652.347296:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 25 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509652.347345:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774799744 00000100:00100000:2.0:1788509652.347349:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774799744 00010000:00010000:2.0:1788509652.347366:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 26 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509652.347392:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788509652.347404:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+26:2407:x1875387774799616:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509652.347423:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509652.347431:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 26 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347472:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 26 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347515:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df077 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553588 expref: 26 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347536:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509652.347542:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347552:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347561:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509652.347650:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+25:2407:x1875387774799616:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 246us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509652.347658:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788509652.347681:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788509652.347687:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdbd3b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+24:2407:x1875387774799744:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509652.347696:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509652.347702:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 24 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347712:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 24 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347739:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df062 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e4647553581 expref: 24 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347751:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509652.347755:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347763:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347772:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347804:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509652.347826:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdbd3b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+23:2407:x1875387774799744:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 139us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509652.347833:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00010000:00010000:2.0:1788509652.347890:0:19934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.347955:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509652.347981:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788509652.348198:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a200/0xe5156b86310df0bd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535a4 expref: 24 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.348216:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590b400/0xe5156b86310df0c4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535a4 expref: 23 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.348237:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509652.348240:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788509652.348243:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb590b400, rc 0) 00000100:00100000:2.0:1788509652.348276:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+23:15653:x1875387774799488:12345-192.168.203.12@tcp:101:dd.0 Request processed in 9201us (9688us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788509652.348283:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788509652.351038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509652.352145:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774799872 00000100:00100000:2.0:1788509652.352161:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774799872 00000100:00100000:2.0:1788509652.352247:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788509652.352261:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+23:15653:x1875387774799872:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788509652.352293:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509652.352321:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226e00/0xe5156b86310df0d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535ab expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.352367:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.352397:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.352413:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.353208:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226e00/0xe5156b86310df0d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 25 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.353235:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.353257:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509652.353261:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788509652.353266:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226800, rc 0) 00000100:00100000:2.0:1788509652.353647:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+24:15653:x1875387774799872:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1387us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509652.353657:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788509652.372249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509652.372486:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774800128 00000100:00100000:1.0:1788509652.372508:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774800128 00000100:00100000:1.0:1788509652.372589:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788509652.372622:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+24:15653:x1875387774800128:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1788509652.373249:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509652.373275:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509652.373290:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788509652.373343:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788509652.373407:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046944025 reply state 00000000f401a437 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509652.373422:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509652.373430:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:1.0:1788509652.373434:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788509652.373438:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788509652.373568:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+27:15653:x1875387774800128:12345-192.168.203.12@tcp:36:dd.0 Request processed in 948us (1331us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788509652.373576:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000020:00080000:1.0:1788509652.373582:0:17144:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788509652.377165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509652.378456:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774800256 00000100:00100000:3.0:1788509652.378476:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774800256 00000100:00100000:3.0:1788509652.378567:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788509652.378581:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+27:15653:x1875387774800256:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1788509652.378615:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509652.378642:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030400/0xe5156b86310df0e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535b2 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509652.378852:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030400/0xe5156b86310df0e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b2 expref: 28 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509652.378871:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030400/0xe5156b86310df0e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b2 expref: 28 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509652.379871:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:3.0:1788509652.379876:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788509652.379881:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030400, rc 0) 00000100:00100000:3.0:1788509652.380921:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+28:15653:x1875387774800256:12345-192.168.203.12@tcp:101:dd.0 Request processed in 2319us (3747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509652.380946:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788509652.402234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509652.403497:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774800512 00000100:00100000:2.0:1788509652.403514:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774800512 00000100:00100000:2.0:1788509652.405510:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788509652.405538:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+28:15653:x1875387774800512:12345-192.168.203.12@tcp:103:dd.0 00010000:00010000:2.0:1788509652.405565:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509652.405603:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030400/0xe5156b86310df0e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b2 expref: 28 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.405630:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509652.405636:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509652.405731:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+27:15653:x1875387774800512:12345-192.168.203.12@tcp:103:dd.0 Request processed in 207us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509652.405739:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788509652.409167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509652.409312:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774800640 00000100:00100000:3.0:1788509652.409325:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774800640 00000100:00100000:3.0:1788509652.409419:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788509652.409432:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+27:15653:x1875387774800640:12345-192.168.203.12@tcp:58:dd.0 00010000:00010000:3.0:1788509652.409587:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509652.409609:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509652.409623:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788509652.423519:0:19934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788509652.424125:0:19934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788509652.424297:0:19934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788509652.424462:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+27:15653:x1875387774800640:12345-192.168.203.12@tcp:58:dd.0 Request processed in 15024us (15301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509652.424477:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788509652.432708:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509652.432867:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774800768 00000100:00100000:2.0:1788509652.432889:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774800768 00000100:00100000:2.0:1788509652.433004:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788509652.433017:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+27:15653:x1875387774800768:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788509652.433054:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509652.433082:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535b9 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.433168:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.433181:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b9 expref: 28 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.433204:0:17145:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.433219:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b9 expref: 28 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.433236:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509652.433240:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509652.433244:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b9 expref: 28 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509652.433253:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227c00, rc 0) 00000100:00100000:2.0:1788509652.433488:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+28:15653:x1875387774800768:12345-192.168.203.12@tcp:101:dd.0 Request processed in 303us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509652.433498:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00010000:00010000:0.0:1788509652.886645:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509653.207966:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796895872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788509653.208073:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509653.208451:0:17886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796895872 00000100:00100000:0.0:1788509653.208462:0:17886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796895872 00000100:00100000:0.0:1788509653.208538:0:17886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788509653.208549:0:17886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796895872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788509653.208593:0:17886:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788509653.208664:0:17886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796895872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509653.208672:0:17886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788509653.208768:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796895872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788509653.212135:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788509653.212356:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796896000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788509653.212463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509653.212661:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796896000 00000100:00100000:2.0:1788509653.212673:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796896000 00000100:00100000:2.0:1788509653.212752:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788509653.212764:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796896000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788509653.212827:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788509653.212892:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796896000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.212923:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788509653.213170:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796896000:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788509653.398645:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788509653.398659:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509653.398690:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788509653.398702:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788509653.403543:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1875387796896128:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788509653.403644:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87436540 going to sleep for 11 seconds 00000100:00100000:0.0:1788509653.411432:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc8119d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1875387796896128:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788509653.411965:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509653.414386:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774800896 00000100:00100000:1.0:1788509653.414523:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774800896 00000100:00100000:1.0:1788509653.414773:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788509653.414791:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+28:15654:x1875387774800896:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788509653.414838:0:17144:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788509653.415051:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+28:15654:x1875387774800896:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 265us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509653.415059:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00080000:3.0:1788509653.415442:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788509653.421139:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.421397:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774801024 00000100:00100000:2.0:1788509653.421411:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774801024 00000100:00100000:2.0:1788509653.421489:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788509653.421502:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+28:15654:x1875387774801024:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788509653.421603:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.421626:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.421642:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.421855:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.421879:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.421892:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422026:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422037:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422061:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509653.422118:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788509653.422121:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788509653.422141:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422153:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422159:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422166:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422172:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.422177:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422185:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422206:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc86027200) 00010000:00010000:2.0:1788509653.422209:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509653.422214:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422220:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227200/0xe5156b86310df0fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422248:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422254:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422259:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422264:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.422267:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422273:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422281:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8bcdbd047000) 00010000:00010000:2.0:1788509653.422284:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509653.422287:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422293:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df103 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422311:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422456:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422462:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422475:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.422478:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422483:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422491:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509653.422494:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509653.422497:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.422502:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df10a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509653.422604:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+28:15654:x1875387774801024:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1100us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.422615:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788509653.425114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.425219:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774801280 00000100:00100000:2.0:1788509653.425228:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774801280 00000100:00100000:2.0:1788509653.425291:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788509653.425302:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+28:15654:x1875387774801280:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509653.425330:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509653.425351:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df111 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535c0 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425467:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425500:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425512:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788509653.425525:0:19934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788509653.425607:0:19934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425616:0:19934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425623:0:19934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425629:0:19934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226400 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.425633:0:19934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425641:0:19934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425652:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509653.425656:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788509653.425661:0:19934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425667:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df118 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425703:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df111 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535c0 expref: 30 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425719:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bcc86027200) 00010000:00010000:2.0:1788509653.425721:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788509653.425725:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df111 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535c0 expref: 30 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.425734:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226c00, rc 0) 00000100:00100000:2.0:1788509653.425790:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc8119ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+29:15654:x1875387774801280:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 490us (682us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788509653.425798:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788509653.429088:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.429222:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774801408 00000100:00100000:3.0:1788509653.429239:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774801408 00000100:00100000:3.0:1788509653.429403:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788509653.429418:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+29:15654:x1875387774801408:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788509653.429468:0:17146:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788509653.429698:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+29:15654:x1875387774801408:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 283us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509653.429717:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788509653.432537:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.432718:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774801664 00000100:00100000:2.0:1788509653.432735:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774801664 00000100:00100000:2.0:1788509653.432886:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1788509653.432948:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+29:15654:x1875387774801664:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509653.432969:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509653.432990:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df126 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535c7 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788509653.433395:0:19934:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1788509653.433402:0:19934:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788509653.433423:0:19934:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788509653.433581:0:19934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df12d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.433597:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df12d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.433609:0:19934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df12d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.433677:0:19934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226c00/0xe5156b86310df126 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535c7 expref: 32 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.433694:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df12d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535c7 expref: 31 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.433703:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcdbd047000) 00010000:00010000:2.0:1788509653.433706:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788509653.433709:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226400, rc 0) 00000100:00100000:2.0:1788509653.433780:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+31:15654:x1875387774801664:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 883us (1255us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788509653.433788:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788509653.436109:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.436191:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774801920 00000100:00100000:2.0:1788509653.436202:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774801920 00000100:00100000:2.0:1788509653.436272:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1788509653.436283:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc865dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+31:15654:x1875387774801920:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788509653.436366:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509653.436410:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226400/0xe5156b86310df12d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535c7 expref: 31 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436432:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcdbd047000) 00010000:00010000:2.0:1788509653.436447:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788509653.436474:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436489:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436513:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436573:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436582:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436590:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436635:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436642:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436649:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436655:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1227a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.436659:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436667:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436677:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:2.0:1788509653.436680:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509653.436683:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436697:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df13b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436706:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436712:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436717:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436722:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.436725:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436730:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436738:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc7dffe8c (ffff8bcdbd047100) 00010000:00010000:2.0:1788509653.436740:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509653.436743:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.436749:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df142 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc7dffe8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509653.436831:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc865dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+30:15654:x1875387774801920:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 549us (730us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788509653.436840:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788509653.439792:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509653.439934:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774802048 00000100:00100000:1.0:1788509653.439943:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774802048 00000100:00100000:1.0:1788509653.439994:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788509653.440003:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+30:15654:x1875387774802048:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509653.440022:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509653.440042:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925a00/0xe5156b86310df149 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535ce expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.440075:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925000/0xe5156b86310df150 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.440088:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925000/0xe5156b86310df150 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.440098:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925000/0xe5156b86310df150 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.440211:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925a00/0xe5156b86310df149 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ce expref: 32 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.440228:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925000/0xe5156b86310df150 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ce expref: 31 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.440246:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:1.0:1788509653.440249:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788509653.440252:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92925000, rc 0) 00000100:00100000:1.0:1788509653.441054:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+31:15654:x1875387774802048:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 313us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509653.441063:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788509653.447390:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.447469:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774802304 00000100:00100000:2.0:1788509653.447478:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774802304 00000100:00100000:2.0:1788509653.447537:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788509653.447547:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+31:15654:x1875387774802304:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788509653.447624:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.447640:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.447650:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788509653.447814:0:17145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788509653.447824:0:17145:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 550608924907ns, next at 551608922862ns, rc = 0 00000004:00010000:2.0:1788509653.447873:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a8640a5 reply state 000000001f96f4bb transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.447886:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.447892:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:2.0:1788509653.447895:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788509653.448072:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788509653.448196:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+33:15654:x1875387774802304:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 649us (824us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788509653.448204:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788509653.455055:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.455205:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774802432 00000100:00100000:2.0:1788509653.455215:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774802432 00000100:00100000:2.0:1788509653.455337:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788509653.455348:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+33:15654:x1875387774802432:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509653.455394:0:19934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509653.455416:0:19934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535d5 expref: -99 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.455483:0:19934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 34 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.455500:0:19934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 34 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.455519:0:19934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:2.0:1788509653.455522:0:19934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788509653.455526:0:19934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1227a00, rc 0) 00000100:00100000:2.0:1788509653.455591:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+34:15654:x1875387774802432:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 245us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.455599:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1788509653.477250:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.477398:0:19531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774802560 00000100:00100000:2.0:1788509653.477410:0:19531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774802560 00000100:00100000:2.0:1788509653.477501:0:19531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788509653.477515:0:19531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2407:x1875387774802560:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788509653.477867:0:19531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2407:x1875387774802560:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 354us (629us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788509653.477875:0:19531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00080000:3.0:1788509653.478176:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788509653.485521:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509653.485768:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774802816 00000100:00100000:1.0:1788509653.485784:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774802816 00000100:00100000:1.0:1788509653.486031:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788509653.486043:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+34:15654:x1875387774802816:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788509653.487041:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+35:15654:x1875387774802816:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 997us (1532us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788509653.487051:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788509653.490425:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.490590:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774803072 00000100:00100000:3.0:1788509653.490602:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774803072 00000100:00100000:3.0:1788509653.490676:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:3.0:1788509653.490687:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+35:15654:x1875387774803072:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788509653.491624:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+35:15654:x1875387774803072:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 932us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509653.491637:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788509653.495053:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509653.495270:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774803200 00000100:00100000:1.0:1788509653.495294:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774803200 00000100:00100000:1.0:1788509653.495434:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788509653.495447:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+35:15654:x1875387774803200:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788509653.495475:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788509653.495502:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df165 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535dc expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.495601:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925400/0xe5156b86310df16c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.495636:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925400/0xe5156b86310df16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.495650:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925400/0xe5156b86310df16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788509653.495718:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788509653.495744:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925400/0xe5156b86310df16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.495777:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df165 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535dc expref: 37 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.495798:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925400/0xe5156b86310df16c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535dc expref: 36 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.495807:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:1.0:1788509653.495811:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788509653.495815:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd92925400, rc 0) 00000100:00100000:1.0:1788509653.495893:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+36:15654:x1875387774803200:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 448us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509653.495962:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1788509653.501337:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.501494:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774803328 00000100:00100000:2.0:1788509653.501508:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774803328 00000100:00100000:2.0:1788509653.501581:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788509653.501594:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd9ed92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2408:x1875387774803328:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509653.501636:0:18650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509653.501664:0:18650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535e3 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788509653.501697:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a7dd4, blocks: 0x0 00010000:00010000:2.0:1788509653.501751:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1788509653.501757:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509653.501769:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 7 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.501794:0:18650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 7 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.501809:0:18650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226400, rc 0) 00000100:00100000:2.0:1788509653.501875:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd9ed92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:2408:x1875387774803328:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 283us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.501883:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1788509653.505604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.506247:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774803584 00000100:00100000:2.0:1788509653.506260:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774803584 00000100:00100000:2.0:1788509653.506350:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788509653.506362:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+36:15654:x1875387774803584:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788509653.506514:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+36:15654:x1875387774803584:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 154us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.506523:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788509653.509365:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.509481:0:19934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774803712 00000100:00100000:2.0:1788509653.509502:0:19934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774803712 00000100:00100000:2.0:1788509653.509564:0:19934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788509653.509575:0:19934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+36:15654:x1875387774803712:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788509653.515343:0:17124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788509653.515367:0:17124:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788509653.515448:0:17124:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1788509653.515475:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515490:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515498:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515505:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.515511:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515520:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515541:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bcdbd047200) 00010000:00010000:2.0:1788509653.515544:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509653.515550:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515557:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226200/0xe5156b86310defac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515581:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515587:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515601:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515606:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846ec00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.515609:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515616:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515625:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:2.0:1788509653.515628:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509653.515631:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515637:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846ec00/0xe5156b86310defb3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515656:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515663:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515669:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515674:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.515676:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515693:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.515702:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8bcc87343000) 00010000:00010000:2.0:1788509653.515705:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788509653.515926:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788509653.515948:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796896256:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788509653.516208:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.516215:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925c00/0xe5156b86310df05b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.516236:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.516242:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.516247:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.516251:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.516254:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.516259:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.516268:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:2.0:1788509653.516270:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788509653.516273:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.516764:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.516781:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.516787:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.516793:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcc8846e600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509653.516796:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.516803:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.516815:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bcc86027400) 00010000:00010000:0.0:1788509653.516817:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788509653.516820:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.516826:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcc8846e600/0xe5156b86310df000 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.517105:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925200/0xe5156b86310df0e0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.517119:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.517125:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.517131:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.517135:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:2.0:1788509653.517138:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.517144:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.517154:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:2.0:1788509653.517157:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788509653.517160:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.517166:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226a00/0xe5156b86310df157 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509653.517483:0:19934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+15:15654:x1875387774803712:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 7904us (8125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509653.517496:0:19934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788509653.517599:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509653.517702:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796896256 00000100:00100000:1.0:1788509653.517713:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796896256 00000100:00100000:1.0:1788509653.517780:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788509653.517791:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796896256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788509653.518021:0:19129:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788509653.518025:0:19129:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788509653.518028:0:19129:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788509653.518030:0:19129:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788509652 -> 1788509652 00002000:00010000:1.0:1788509653.518032:0:19129:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788509653.518075:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875387796896256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 285us (476us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788509653.518082:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1788509653.518124:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bcd87c6ed80/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788509653.518132:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796896256:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788509653.520516:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509653.520947:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509653.521970:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774803840 00000100:00100000:0.0:1788509653.521986:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774803840 00000100:00100000:0.0:1788509653.522066:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788509653.522078:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:2407:x1875387774803840:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788509653.522236:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:2407:x1875387774803840:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 159us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509653.522257:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788509653.527408:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509653.527661:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774804096 00000100:00100000:0.0:1788509653.527675:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774804096 00000100:00100000:0.0:1788509653.527763:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788509653.527775:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+15:15654:x1875387774804096:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788509653.527849:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788509653.527883:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925400/0xe5156b86310df16c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535dc expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.527936:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:0.0:1788509653.527942:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788509653.527983:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310df17a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.528001:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310df17a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.528022:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310df17a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788509653.528188:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be85858e reply state 00000000f9bbe326 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310df17a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.528521:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a600/0xe5156b86310df17a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.528529:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:0.0:1788509653.528532:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788509653.528558:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788509653.528741:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+16:15654:x1875387774804096:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 967us (1347us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788509653.528751:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788509653.532592:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.532697:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774804224 00000100:00100000:2.0:1788509653.532764:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774804224 00000100:00100000:2.0:1788509653.532889:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788509653.532940:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:15654:x1875387774804224:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788509653.532966:0:18651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788509653.532990:0:18651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535ea expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.533236:0:18651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 8 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.533247:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509653.533252:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509653.533259:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 8 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.533315:0:18651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 8 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.533332:0:18651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 8 pid: 18650 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509653.533349:0:18651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc87dfca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18651:1875387796896384:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788509653.533467:0:18651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc81ae6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788509653.536296:0:18651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc87dfca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18651:1875387796896384:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788509653.536344:0:18651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 8 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.536378:0:18651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcdb1226200, rc 0) 00000100:00100000:0.0:1788509653.536451:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+8:15654:x1875387774804224:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3552us (3871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509653.536462:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788509653.538346:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.538552:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774804352 00000100:00100000:3.0:1788509653.538563:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774804352 00010000:00010000:3.0:1788509653.538614:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 8 pid: 18650 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509653.538667:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788509653.538678:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+8:2407:x1875387774804352:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509653.538696:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509653.538735:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 8 pid: 18650 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.538751:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 8 pid: 18650 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.538780:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009167a43b/0xe5156b86310df173 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535e3 expref: 8 pid: 18650 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.538801:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509653.538806:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509653.538815:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 7 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.538826:0:17130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 7 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.538884:0:17130:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 7 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509653.538947:0:17130:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17130:1875387796896512:192.168.203.12@tcp:105: 00000100:00100000:3.0:1788509653.539165:0:17130:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8109a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788509653.542563:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509653.542663:0:17130:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17130:1875387796896512:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788509653.542693:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509653.542771:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:2407:x1875387774804352:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4093us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.542784:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788509653.549158:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774804480 00000100:00100000:1.0:1788509653.549182:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774804480 00000100:00100000:1.0:1788509653.549288:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788509653.549300:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:2408:x1875387774804480:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788509653.549512:0:19129:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788509653.549517:0:19129:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788509651 00002000:00010000:1.0:1788509653.549520:0:19129:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788509650 00002000:00010000:1.0:1788509653.549521:0:19129:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788509652 -> 1788509651 00002000:00010000:1.0:1788509653.549523:0:19129:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788509653.549599:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+8:2408:x1875387774804480:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 301us (7048us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788509653.549608:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788509653.555586:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.555671:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774804608 00000100:00100000:3.0:1788509653.555685:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774804608 00000100:00100000:3.0:1788509653.555857:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788509653.555869:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+8:2408:x1875387774804608:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788509653.555946:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.555972:0:18650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 8 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.555982:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509653.555987:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788509653.555993:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.556167:0:18650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 8 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.556184:0:18650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 8 pid: 18651 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509653.556240:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18650:1875387796896640:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788509653.556349:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc8109a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788509653.560623:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.560756:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18650:1875387796896640:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788509653.560791:0:18650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509653.561206:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774804736 00000100:00100000:2.0:1788509653.561216:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774804736 00010000:00010000:2.0:1788509653.561267:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 9 pid: 18651 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509653.561428:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788509653.561441:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+9:2408:x1875387774804736:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788509653.561461:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788509653.561490:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 9 pid: 18651 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.561506:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 9 pid: 18651 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.561534:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008ae0549/0xe5156b86310df181 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ea expref: 9 pid: 18651 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.561553:0:17129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788509653.561558:0:17129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788509653.561565:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.561601:0:17129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.561794:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788509653.561876:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+8:2408:x1875387774804736:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 436us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.561885:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:3.0:1788509653.563454:0:18650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.563844:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.564119:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.564129:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.564139:0:18650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.564147:0:18650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509653.564152:0:18650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.564186:0:18650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.564209:0:18650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.564218:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df188 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788509653.564509:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+7:2408:x1875387774804608:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 8636us (8929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.564522:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788509653.567562:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509653.567671:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774804992 00000100:00100000:1.0:1788509653.567687:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774804992 00000100:00100000:1.0:1788509653.567853:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1788509653.567866:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+16:15654:x1875387774804992:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788509653.568237:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.568289:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.568300:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.568347:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.568364:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 16 pid: 17145 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509653.568392:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17144:1875387796896768:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509653.568501:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc81a2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788509653.571264:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.571508:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774805120 00000100:00100000:3.0:1788509653.571520:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774805120 00010000:00010000:3.0:1788509653.571568:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 17 pid: 17145 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509653.571617:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788509653.571630:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+17:2407:x1875387774805120:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509653.571647:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509653.571656:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 17 pid: 17145 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.571671:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 17 pid: 17145 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.571697:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:3.0:1788509653.571714:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b9 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.571747:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.571755:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.571764:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.571789:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509653.571866:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+17:2407:x1875387774805120:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 239us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509653.571875:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00010000:00010000:1.0:1788509653.573190:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1226800/0xe5156b86310df0d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535ab expref: 16 pid: 17145 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509653.573215:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17144:1875387796896768:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509653.573244:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.573254:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.573260:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.573545:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.573571:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 16 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.573582:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.573628:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 16 pid: 19934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.573647:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 16 pid: 19934 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509653.573663:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17144:1875387796896896:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788509653.574061:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc81a2fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788509653.581093:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509653.581332:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17144:1875387796896896:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788509653.581380:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509653.583971:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774805248 00000100:00100000:3.0:1788509653.583993:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774805248 00010000:00010000:3.0:1788509653.584131:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 17 pid: 19934 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509653.584188:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788509653.584199:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+17:2407:x1875387774805248:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788509653.584217:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788509653.584225:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 17 pid: 19934 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.584242:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 17 pid: 19934 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.584585:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227a00/0xe5156b86310df15e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x1a882e46475535d5 expref: 17 pid: 19934 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.584607:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:3.0:1788509653.584614:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.584625:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.584634:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.584791:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788509653.584874:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+16:2407:x1875387774805248:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 676us (3796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509653.584884:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00010000:00010000:1.0:1788509653.586837:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.586856:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788509653.587259:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788509653.587496:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788509653.587539:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788509653.587644:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17144:1875387796897024:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788509653.588700:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509653.588864:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc81a2fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788509653.589248:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796897024 00000100:00100000:2.0:1788509653.589260:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796897024 00000100:00100000:2.0:1788509653.589454:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788509653.589467:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17144:x1875387796897024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788509653.589597:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17144:x1875387796897024:12345-0@lo:1000:mdt00_000.0 Request processed in 132us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509653.589605:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788509653.589686:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17144:1875387796897024:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788509653.589947:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788509653.590039:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17144:1875387796897152:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788509653.590102:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509653.594527:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc81a2f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788509653.594617:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796897152 00000100:00100000:0.0:1788509653.594629:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796897152 00000100:00100000:0.0:1788509653.594770:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788509653.594785:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17144:x1875387796897152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788509653.595220:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17144:x1875387796897152:12345-0@lo:1000:mdt00_000.0 Request processed in 439us (5117us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788509653.595230:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788509653.595603:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874db480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17144:1875387796897152:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788509653.595835:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.595849:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.595878:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.595885:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924a00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509653.595890:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596084:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596107:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:0.0:1788509653.596111:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788509653.596118:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596126:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924a00/0xe5156b86310df196 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596166:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596173:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596179:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596185:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030200 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:0.0:1788509653.596188:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596204:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596215:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:0.0:1788509653.596217:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788509653.596225:0:17144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b9 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596239:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b9 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596250:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b9 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.596399:0:17144:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb1227c00/0xe5156b86310df0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535b9 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509653.596417:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17144:1875387796897280:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788509653.596555:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bcc87436a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788509653.600966:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.601209:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774805376 00000100:00100000:3.0:1788509653.601221:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774805376 00000100:00100000:3.0:1788509653.601302:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788509653.601315:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc877a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+20:15653:x1875387774805376:12345-192.168.203.12@tcp:49:dd.0 00000100:00100000:3.0:1788509653.601476:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc877a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+20:15653:x1875387774805376:12345-192.168.203.12@tcp:49:dd.0 Request processed in 164us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509653.601484:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788509653.603833:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.606247:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774805504 00000100:00100000:3.0:1788509653.606268:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774805504 00000100:00100000:3.0:1788509653.606532:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788509653.606563:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+20:15653:x1875387774805504:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1788509653.606592:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788509653.606620:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030000/0xe5156b86310df19d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a882e46475535f1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.606665:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.606679:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.606689:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.606711:0:17146:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.606723:0:17146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509653.606939:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17144:1875387796897280:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788509653.606968:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.606976:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030200/0xe5156b86310df0ee lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 19934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607262:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607286:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607300:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607311:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607318:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607324:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607330:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92925600 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509653.607334:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607357:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607379:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:1.0:1788509653.607383:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788509653.607388:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607394:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92925600/0xe5156b86310df1ab lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607405:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607410:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607415:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607420:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd92924c00 already unused, calling callback (ffffffffc1a334f0) 00010000:00010000:1.0:1788509653.607422:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607427:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607434:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:1.0:1788509653.607437:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788509653.607439:0:17144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607455:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607461:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607479:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788509653.607485:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd92924c00/0xe5156b86310df18f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788509653.607699:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+21:15654:x1875387774804992:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 39835us (40150us total) trans 8589934620 rc 0/0 00000040:00080000:0.0:1788509653.609525:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788509653.609544:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788509653.609575:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788509653.609586:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788509653.610249:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000020:00080000:1.0:1788509653.610260:0:17144:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:3.0:1788509653.610399:0:17146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.610413:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.610584:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030000/0xe5156b86310df19d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535f1 expref: 22 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.610607:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcd80030a00/0xe5156b86310df1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x1a882e46475535f1 expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.610632:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bcc87343600) 00010000:00010000:3.0:1788509653.610635:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788509653.610640:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bcd80030a00, rc 0) 00000100:00100000:0.0:1788509653.615563:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.615935:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+20:15653:x1875387774805504:12345-192.168.203.12@tcp:101:dd.0 Request processed in 9371us (12108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509653.615950:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1788509653.617363:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774805760 00000100:00100000:0.0:1788509653.617397:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774805760 00000100:00100000:0.0:1788509653.617483:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788509653.617495:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+20:15654:x1875387774805760:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788509653.617859:0:17148:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788509653.617920:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788509653.617961:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.617981:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.617995:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618005:0:17148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618010:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618017:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618037:0:17148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788509653.618151:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+22:15654:x1875387774805760:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 656us (2599us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788509653.618180:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000020:00080000:0.0:1788509653.618186:0:17148:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788509653.618226:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788509653.618234:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618242:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb590a800 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509653.618247:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618257:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618272:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8bcc87343d00) 00010000:00010000:0.0:1788509653.618276:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788509653.618281:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618288:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bcdb590a800/0xe5156b86310df1b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.618301:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509653.618303:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788509653.618305:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509653.697990:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788509653.698059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509653.698081:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774806016 00000100:00100000:3.0:1788509653.698097:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774806016 00000100:00100000:3.0:1788509653.698179:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774805888 00000100:00100000:3.0:1788509653.698183:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774805888 00000100:00100000:3.0:1788509653.698215:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788509653.698228:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+8:2407:x1875387774806016:12345-192.168.203.12@tcp:4:dd.0 00002000:00010000:3.0:1788509653.698345:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9a7dd3, atime: 0x6a9a7dd2, ctime: 0x6a9a7dd3, blocks: 0x0 00010000:00010000:3.0:1788509653.698364:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.698394:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=550s v=(0 0) 00010000:00010000:3.0:1788509653.698399:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788509653.698410:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.698428:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788509653.744218:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1788509653.744248:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1788509653.744517:0:18654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:3.0:1788509653.744523:0:18654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788509651 -> 1788509653 00002000:00010000:3.0:1788509653.744544:0:18654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788509651 -> 1788509653 00002000:00010000:3.0:1788509653.744546:0:18654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:3.0:1788509653.744567:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.744583:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.744593:0:18654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.744601:0:18654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcd80030000 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:3.0:1788509653.744607:0:18654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.744617:0:18654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.744642:0:18654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788509653.744651:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005544b944/0xe5156b86310df1b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788509653.744794:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+6:2407:x1875387774806016:12345-192.168.203.12@tcp:4:dd.0 Request processed in 46563us (47123us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788509653.744807:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788509653.746923:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788509653.746964:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb787b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2407:x1875387774805888:12345-192.168.203.12@tcp:4:dd.0 00002000:00010000:2.0:1788509653.747038:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a9a7dd5, atime: 0x6a9a7dd2, ctime: 0x6a9a7dd5, blocks: 0x1a68 00010000:00010000:2.0:1788509653.747064:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.747084:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1788509653.747089:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788509653.747097:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788509653.747125:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788509653.827980:0:18645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788509653.828176:0:18654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788509653.828202:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.828231:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.828240:0:18654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.828248:0:18654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bcdb1226c00 already unused, calling callback (ffffffffc0e3a4f0) 00010000:00010000:0.0:1788509653.828253:0:18654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.828264:0:18654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.828285:0:18654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788509653.828294:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd65a62d/0xe5156b86310df1c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788509653.828412:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb787b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2407:x1875387774805888:12345-192.168.203.12@tcp:4:dd.0 Request processed in 81465us (130351us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788509653.828428:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00010000:00010000:0.0:1788509653.910052:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788509654.230168:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796897536:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.230291:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509654.230382:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796897664:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.230393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796898048:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.230445:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788509654.230473:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509654.230487:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796898560:0@lo:400:kworker.0 00000100:00100000:3.0:1788509654.230521:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd913e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796898176:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.230530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509654.230564:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796897664 00000100:00100000:3.0:1788509654.230568:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509654.230574:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796899072:0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.230576:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796897664 00000100:00100000:3.0:1788509654.230605:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796898688:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.230633:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509654.230650:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796898176 00000100:00100000:2.0:1788509654.230656:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796898176 00000100:00100000:3.0:1788509654.230664:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509654.230678:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788509654.230688:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788509654.230694:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb787ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796897408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509654.230706:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796897664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788509654.230715:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796899200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788509654.230740:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509654.230856:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796897792:0@lo:400:kworker.0 00000100:00100000:3.0:1788509654.230974:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509654.237580:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875387796897664:12345-0@lo:400:kworker.0 Request processed in 6866us (7097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.237602:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788509654.237678:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788509654.237697:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796898176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.237774:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796898176:12345-0@lo:400:kworker.0 Request processed in 88us (7211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.237781:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788509654.237815:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796898048 00000100:00100000:2.0:1788509654.237826:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796898048 00000100:00100000:2.0:1788509654.237863:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796898560 00000100:00100000:2.0:1788509654.237887:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796898560 00000100:00100000:2.0:1788509654.237932:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796899072 00000100:00100000:2.0:1788509654.237936:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796899072 00000100:00100000:2.0:1788509654.237968:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796898688 00000100:00100000:2.0:1788509654.237972:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796898688 00000100:00100000:2.0:1788509654.237988:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788509654.237994:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796898048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.238031:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875387796898048:12345-0@lo:400:kworker.0 Request processed in 38us (7588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.238037:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788509654.238048:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788509654.238054:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796898560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.238083:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875387796898560:12345-0@lo:400:kworker.0 Request processed in 29us (7555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.238088:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788509654.238098:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788509654.238104:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796899072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.238131:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875387796899072:12345-0@lo:400:kworker.0 Request processed in 28us (7504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.238137:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788509654.238146:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788509654.238151:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796898688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.238176:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875387796898688:12345-0@lo:400:kworker.0 Request processed in 25us (7516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.238181:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788509654.238197:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788509654.238201:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788509654.238296:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796897408 00000100:00100000:2.0:1788509654.238300:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796897408 00000100:00100000:2.0:1788509654.238319:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796899200 00000100:00100000:2.0:1788509654.238322:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796899200 00000100:00100000:2.0:1788509654.238340:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788509654.238345:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796897408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788509654.238382:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788509654.238419:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796897408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (7681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.238425:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788509654.238435:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788509654.238440:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796899200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788509654.238456:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788509654.238481:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875387796899200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (7507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.238485:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788509654.238497:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509654.243020:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788509654.243031:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bcd87c6ed80, transno 8589934596 00000004:00080000:0.0:1788509654.243049:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788509654.243089:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb787ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796897408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788509654.243156:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796897536 00000100:00100000:2.0:1788509654.243171:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796897536 00000100:00100000:0.0:1788509654.243233:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796897920:0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.243270:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788509654.243289:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3647:x1875387796897536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.243345:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509654.243391:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796897920 00000100:00100000:0.0:1788509654.243398:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796897920 00000100:00100000:2.0:1788509654.243400:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:830aae98-6419-4d90-97fb-7d4af2af47a0+24:3647:x1875387796897536:12345-0@lo:400:kworker.0 Request processed in 116us (13113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.243417:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788509654.243476:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788509654.243489:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796897920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788509654.243513:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788509654.243550:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875387796897920:12345-0@lo:400:kworker.0 Request processed in 63us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509654.243557:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788509654.243589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875387796897920:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.243597:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796898432:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.243620:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509654.243667:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796898944:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.243692:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509654.243715:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796898944 00000100:00100000:0.0:1788509654.243718:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796898944 00000100:00100000:0.0:1788509654.243755:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788509654.243761:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd87c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796898944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.244003:0:19129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796898432 00000100:00100000:2.0:1788509654.244009:0:19129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796898432 00000100:00100000:2.0:1788509654.244045:0:19129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788509654.244068:0:19129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796898432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.244116:0:19129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875387796898432:12345-0@lo:400:kworker.0 Request processed in 50us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.244124:0:19129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788509654.244160:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788509654.245035:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509654.245121:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796898304:0@lo:400:kworker.0 00000100:00100000:1.0:1788509654.245156:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788509654.245227:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796897792 00000100:00100000:2.0:1788509654.245233:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796897792 00000100:00100000:2.0:1788509654.245267:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796898304 00000100:00100000:2.0:1788509654.245270:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796898304 00000100:00100000:2.0:1788509654.245594:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788509654.245603:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796897792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.245654:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796897792:12345-0@lo:400:kworker.0 Request processed in 53us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.245660:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788509654.245680:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788509654.245686:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc874d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796898304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788509654.245709:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc874d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875387796898304:12345-0@lo:400:kworker.0 Request processed in 24us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.245716:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788509654.245733:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788509654.245811:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875387796898304:0@lo:400:kworker.0 00000100:00100000:1.0:1788509654.245820:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcdb7a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796898816:0@lo:400:kworker.0 00000100:00100000:1.0:1788509654.245848:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509654.245866:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796899328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509654.245888:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788509654.245977:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796897792:0@lo:400:kworker.0 00000100:00100000:1.0:1788509654.245999:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796899328 00000100:00100000:1.0:1788509654.246002:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796899328 00000100:00100000:1.0:1788509654.246027:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788509654.246034:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796899328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788509654.246051:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788509654.246086:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875387796899328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509654.246092:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788509654.246122:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcc874da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875387796899328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788509654.246161:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875387796898048:0@lo:400:kworker.0 00000100:00100000:1.0:1788509654.246175:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875387796898560:0@lo:400:kworker.0 00010000:00080000:1.0:1788509654.246189:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7a22a00 x1875387796899072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788509654.246201:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875387796899072:0@lo:400:kworker.0 00000100:00100000:1.0:1788509654.246212:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:830aae98-6419-4d90-97fb-7d4af2af47a0:3647:1875387796897536:0@lo:400:kworker.0 00000100:00100000:1.0:1788509654.246243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875387796898432:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.246511:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd87c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875387796898944:12345-0@lo:400:kworker.0 Request processed in 2741us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509654.246528:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788509654.246548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875387796898944:0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.246568:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796898816 00000100:00100000:0.0:1788509654.246589:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796898816 00000100:00100000:0.0:1788509654.246649:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788509654.246657:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796898816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788509654.246709:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875387796898816:12345-0@lo:400:kworker.0 Request processed in 53us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509654.246716:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788509654.246781:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8bcdb7a21180 x1875387796898816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788509670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788509654.246785:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788509654.246801:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875387796898816:0@lo:400:kworker.0 00000100:00100000:3.0:1788509654.251326:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796899200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788509654.251391:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875387796897664:0@lo:400:kworker.0 00000100:00100000:3.0:1788509654.251405:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd913e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875387796898176:0@lo:400:kworker.0 00000100:00100000:3.0:1788509654.251419:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcdb7a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875387796898688:0@lo:400:kworker.0 00000100:00100000:1.0:1788509654.292187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509654.292235:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509654.292270:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509654.292317:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788509654.292354:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774806400 00000100:00100000:1.0:1788509654.292374:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774806400 00000100:00100000:2.0:1788509654.292417:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774806912 00000100:00100000:2.0:1788509654.292424:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774806912 00000100:00100000:1.0:1788509654.292461:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1788509654.292515:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774806144 00000100:00100000:3.0:1788509654.292520:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774806144 00000100:00100000:3.0:1788509654.292555:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1788509654.292566:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcd89174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:2410:x1875387774806144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509654.292656:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcd89174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86ef4052-0fc2-442c-a938-e9b38a7fbf0b+13:2410:x1875387774806144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 91us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509654.292663:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1788509654.292733:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788509654.292763:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774806656 00000100:00100000:3.0:1788509654.292766:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774806656 00000100:00100000:0.0:1788509654.292796:0:19531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774807168 00000100:00100000:0.0:1788509654.292802:0:19531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774807168 00000100:00100000:1.0:1788509654.292869:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774806400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509654.292943:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774806400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 77us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509654.293059:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1788509654.293067:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774806656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788509654.293105:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774806656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788509654.293113:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1788509654.293563:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1788509654.293577:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774806912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509654.293616:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774806912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.293633:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1788509654.293746:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509654.293778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509654.293806:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509654.294023:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788509654.294152:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774806272 00000100:00100000:2.0:1788509654.294158:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774806272 00000100:00100000:2.0:1788509654.294183:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774806784 00000100:00100000:2.0:1788509654.294185:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774806784 00000100:00100000:2.0:1788509654.294202:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1788509654.294208:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+22:2410:x1875387774806272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509654.294250:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+22:2410:x1875387774806272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.294256:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1788509654.294269:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1788509654.294275:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+6:2410:x1875387774806784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509654.294299:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:969fd51c-5e49-4545-9833-40161db51328+6:2410:x1875387774806784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.294305:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1788509654.294330:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774806528 00000100:00100000:2.0:1788509654.294334:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774806528 00000100:00100000:0.0:1788509654.301137:0:19531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387774807040 00000100:00100000:0.0:1788509654.301165:0:19531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387774807040 00000100:00100000:0.0:1788509654.301228:0:19531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788509654.301240:0:19531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcdb7a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774807168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788509654.302189:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1788509654.302212:0:19531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcdb7a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774807168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 102us (8606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509654.302248:0:19531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1788509654.302257:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788509654.302281:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774807040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1788509654.302324:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788509654.302332:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788509654.302335:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788509654.302338:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788509654.302344:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:969fd51c-5e49-4545-9833-40161db51328+5:2410:x1875387774807040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 77us (8320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788509654.302392:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788509654.302687:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1788509654.302700:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774806528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788509654.302733:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef7b9534-bb6d-4d0d-98ea-73f5051501ca+5:2410:x1875387774806528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (8954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788509654.302751:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00010000:00010000:0.0:1788509654.940432:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788509655.639072:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788509655.639085:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788509655.639109:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788509655.639117:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:0.0:1788509655.711684:0:20320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788509655.958301:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788509657.005772:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788509657.314250:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bcd87c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796899456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788509657.314356:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788509657.317463:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875387796899456 00000100:00100000:0.0:1788509657.317483:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875387796899456 00000100:00100000:0.0:1788509657.317576:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788509657.317589:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bcc87781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796899456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788509657.317630:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788509657.317744:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bcc87781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875387796899456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (3398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788509657.317752:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788509657.317804:0:17140:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788509657.318778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bcd87c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875387796899456:0@lo:13:osp-pre-0-1.0 Debug log: 42478 lines, 42478 kept, 0 dropped, 0 bad.